KR20140130330A - Wearable electronic device and method for controlling the same - Google Patents

Abstract

A wearable electronic device is disclosed. The wearable electronic device comprises: a transparent or transmissive lens unit; a camera unit which captures a foreground recognized by a sight of a smart glasses wearer; a communications unit which transmits position information of the wearable electronic device; and a control unit which controls the communications unit so as to transmit, to a terminal device, an image corresponding to the foreground captured by the wearable electronic device when a request signal for requesting the foreground captured by the wearable electronic device according to the transmitted position information is received from the terminal device.

Description

[0001] Wearable electronic device and method for controlling same [0002]

The present invention relates to a method of controlling a wearable electronic device in the form of a pair of glasses or the like.

The augmented reality is different from the virtual reality technology in that the virtual reality is supplemented and displayed to the user by superimposing the virtual world on the real world, which is advantageous in providing a better sense of reality to the user than the virtual reality.

Generally, the augmented reality uses a display device such as an HMD (Head Mounted Display) or a HUD (Head Up Display) to display various information in front of the user's eyes. In addition, researches on manipulating an augmented object in augmented reality using gesture recognition are actively under way.

The HMD is mounted on the user's head or other part and presents independent projected images to the left and right eyes so that when the user watches the object of view, An image is generated and the binocular parallax enables the perception of the depth sense.

The HUD also projects images in a transparent glass such as glass to allow the user to visually recognize the information projected from the HUD and the external background simultaneously through the transparent glass.

An object of the present invention is to provide a wearable electronic device and a control method thereof, which enable a wearer of a wearable electronic device to collaborate in sports events, .

Another object of the present invention is to provide a wearable electronic device capable of selecting and viewing a live image shared by users at various positions and angles through a method in which each individual wearing a wearable electronic device broadcasts and shares in real time, And a control method thereof.

Another object of the present invention is to provide a wearable electronic device and a control method thereof, in which a viewer and another photographer can request a specific photographer to take a desired photographing action by chatting, and a specific photographer can take a photographing action by receiving the suggestion in real time .

It is still another object of the present invention to provide a method and a system for transmitting a photographed image to a plurality of photographers and transmitting a photographed image to a viewer and transmitting the photographed image to a smart- A wearable electronic device and a control method thereof.

According to an aspect of the present invention, there is provided a wearable electronic device including a transparent or light transmissive lens unit, a camera unit for photographing a foreground recognized by the wearer's vision, A communication unit for transmitting location information of the electronic device; a request signal requesting the foreground photographed by the wearable electronic device according to the transmitted location information, from the terminal device; And a control unit for controlling the communication unit to transmit the image corresponding to the foreground.

The communication unit may receive a foreground photographing request signal different from the photographed foreground from the terminal device.

According to another aspect of the present invention, there is provided a wearable electronic device including a transparent or light transmissive lens unit, a camera unit for photographing a foreground recognized by the wearer's vision, A communication unit for receiving an image photographed by the at least one terminal device from one terminal device, a display unit for displaying a display image on the lens unit, and a display unit for displaying the foreground image corresponding to the photographed foreground and the at least one terminal device And a control unit for controlling the display unit to display the image.

The control unit may display the foreground image as a main image and control the display unit to display an image photographed by the at least one terminal device as an auxiliary image.

According to another aspect of the present invention, there is provided a method of controlling a wearable electronic device having a transparent or light transmissive lens unit, the method comprising: Receiving, from the terminal device, a request signal requesting a foreground photographed by the wearable electronic device in accordance with the transmitted positional information, transmitting the position information of the wearable electronic device to the wearable electronic device, And transmitting an image corresponding to the foreground photographed by the type electronic device.

The method may further include receiving a foreground photographing request signal different from the photographed foreground from the terminal device.

According to another aspect of the present invention, there is provided a method of controlling a wearable electronic device having a transparent or light transmissive lens unit, the method comprising: The method comprising the steps of: receiving an image photographed by the at least one terminal device from at least one terminal device; displaying a foreground image corresponding to the photographed foreground and an image photographed by the at least one terminal device on the lens part .

The displaying step may display the foreground image as a main image and control the display unit to display an image photographed by the at least one terminal device as an auxiliary image.

According to various embodiments of the present invention described above, a smart display glass product is provided with a collaboration image shooting function according to the present invention, thereby greatly improving convenience and interest of the user. SNS and other photographers and external viewers by sharing the interest of smart display glass users, thereby enabling a variety of services through.

1 and 2 are perspective views showing a configuration of a wearable electronic device according to an embodiment of the present invention.
Figure 3 is an illustration of an example of a view seen by a user through a wearable electronic device.
Figs. 4 and 5 are perspective views showing still another embodiment of the configuration of the wearable electronic device. Fig.
6 is a block diagram illustrating an embodiment of a configuration of a wearable electronic device according to the present invention.
7 is a diagram illustrating a content providing system according to an embodiment of the present invention.
8 is a view showing an example of using a terminal device for mounting according to an embodiment of the present invention.
9 to 11 are views showing a control method of a terminal device for mounting according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, only intended for the purpose of enabling understanding of the concepts of the present invention, and are not to be construed as limited to such specifically recited embodiments and conditions do.

It is also to be understood that the detailed description, as well as the principles, aspects and embodiments of the invention, as well as specific embodiments thereof, are intended to cover structural and functional equivalents thereof. It is also to be understood that such equivalents include all elements contemplated to perform the same function irrespective of the currently known equivalents as well as the equivalents to be developed in the future, i.e., the structure.

Thus, for example, it should be understood that the block diagrams herein represent conceptual views of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

The functions of the various elements shown in the figures, including the functional blocks depicted in the processor or similar concept, may be provided by use of dedicated hardware as well as hardware capable of executing software in connection with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

Also, the explicit use of terms such as processor, control, or similar concepts should not be interpreted exclusively as hardware capable of running software, and may be used without limitation as a digital signal processor (DSP) (ROM), random access memory (RAM), and non-volatile memory. Other hardware may also be included.

In the claims hereof, the elements represented as means for performing the functions described in the detailed description include all types of software including, for example, a combination of circuit elements performing the function or firmware / microcode etc. , And is coupled with appropriate circuitry to execute the software to perform the function. It is to be understood that the invention defined by the appended claims is not to be construed as encompassing any means capable of providing such functionality, as the functions provided by the various listed means are combined and combined with the manner in which the claims require .

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings, in which: There will be. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is a perspective view showing the construction of a wearable electronic device according to an embodiment of the present invention. The wearable electronic device 1 shown in Fig. 1 can be manufactured in the form of glasses so as to be positioned close to the user's eyes.

1, which shows a front view of a wearable electronic device 1, a wearable electronic device 1 according to an embodiment of the present invention includes left and right lens frames 10 and 11, 20, left and right hooking portions 30, 31, and right and left lenses 50, 51.

1, a camera 110 may be mounted on a front surface of the frame connector 20, for example, as shown in FIG. 1, Can be disposed.

 Accordingly, the user wears the wearable electronic device 1 in the form of a glass, and can photograph or store or share the picture or the moving picture using the camera 110 while moving.

In this case, the viewpoint of the image captured by the camera 110 may be very similar to the viewpoint of the scene recognized by the user.

In addition, a gesture such as a user's hand movements is recognized using the camera 110, and the operation or function of the wearable electronic device 1 can be controlled according to the recognized gesture.

The position or the number of the camera 110 may be changed as needed, and a special-purpose camera such as an infrared camera may be used.

Further, units for performing a specific function may be arranged in each of the right and left fastening portions 30 and 31. [

The right side-arm 31 may be equipped with user interface devices for receiving user input for controlling the function of the wearable electronic device 1. [

For example, a track ball 100 or a touch pad 101 for selecting or moving an object such as a cursor on a screen, a menu item, or the like may be disposed on the right hook 31.

The user interface device provided in the wearable electronic device 1 is not limited to the track ball 100 and the touch pad 101 but may be a variety of devices such as a key pad dome switch, Input devices may be provided.

On the other hand, a microphone 120 may be mounted on the left side-arm 30, and the operation or function of the wearable electronic device 1 may be detected by using the voice of the user recognized through the microphone 120 Lt; / RTI >

The sensing unit 130 is disposed on the left hook 30 to sense the current state of the wearable electronic device 1 such as the position of the wearable electronic device 1, presence or absence of user contact, bearing, acceleration / deceleration, Thereby generating a sensing signal for controlling the operation of the wearable electronic device 1. [

For example, the sensing unit 130 may include a motion sensor such as a gyroscope or an accelerometer, a position sensor such as a GPS device, a magnetometer, a theodolite, A direction sensor, a temperature sensor, a humidity sensor, a wind direction / wind speed sensor, and the like. However, the present invention is not limited thereto and may include sensors capable of detecting various information in addition to the above sensors.

For example, the sensing unit 130 may further include an infrared sensor. The infrared sensor includes a light emitting unit that emits infrared rays and a light receiving unit that receives infrared rays. The infrared sensor may be used for infrared communication, .

The wearable electronic device 1 according to an embodiment of the present invention may include a communication unit 140 for communication with an external device.

For example, the communication unit 140 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, and a local communication module.

The broadcast receiving module receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated by the broadcast server and transmitting the generated broadcast signals and / or broadcast- The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast-related information may be provided through a mobile communication network, and in this case, it may be received by a mobile communication module.

Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module may be a DMB-T (Digital Multimedia Broadcasting-Terrestrial), a DMB-S (Digital Multimedia Broadcasting-Satellite), a MediaFLO (Media Forward Link Only), a DVB- And a digital broadcasting system such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module may be configured to be suitable not only for the digital broadcasting system described above but also for all broadcasting systems that provide broadcasting signals.

The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in a memory.

On the other hand, the mobile communication module transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module refers to a module for wireless Internet access, and the wireless Internet module can be built in or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module is a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

In addition, the wearable electronic device 1 according to an embodiment of the present invention may include a display device for displaying an image to transmit visual information to a user.

The display device may be configured to include a transparent or light transmissive unit so that a user can see a front view that is displayed in front of the information displayed by the display device.

For example, at least one of the left and right lenses 50, 51 shown in Fig. 1 functions as a transparent display as described above, so that the user can visually recognize the text or image formed on the lens, Can be seen.

For this purpose, the wearable electronic device 1 can display various information in front of the user by using a display device such as an HMD (Head Mounted Display) or a HUD (Head Up Display).

The HMD includes a lens that enlarges an image to form a virtual image, and a display panel disposed at a position closer to the focal distance of the lens. When the HMD is mounted near the user's head, the user can visually recognize the virtual image by viewing the image displayed on the display panel through the lens.

In the HUD, an image displayed on a display panel is enlarged through a lens, the enlarged image is reflected by a half mirror, and the reflected light is displayed to a user, thereby forming a virtual image. In addition, since the half mirror transmits external light, the user can see the foreground as well as the virtual image formed by the HUD by the light from the outside passing through the half mirror.

The display device may be implemented using various transparent display methods such as TOLED (Transparent OLED).

Hereinafter, an embodiment of the present invention will be described by exemplifying that the wearable electronic device 1 has the HUD, but the present invention is not limited thereto.

Referring to the rear surface configuration of the wearable electronic device 1 shown in Fig. 2, HUDs 150 and 151, which function similar to a projector, are provided on the rear surface of at least one of the left hooking portion 30 and the right hooking portion 31, Can be mounted.

The image formed by the HUDs 150 and 151 is reflected by the left and right lenses 50 and 51 and is displayed to the user so that the object 200 formed by the HUDs 150 and 151 is reflected by the left and right lenses 50 and 51, 51). ≪ / RTI >

In this case, the object 200 and the foreground 250 displayed on the left and right lenses 50 and 51 by the HUDs 150 and 151 can be observed together with the user's field of view, as shown in Fig.

The object 200 displayed on the left and right lenses 50 and 51 by the HUDs 150 and 151 is not limited to the menu icon as shown in Fig. 3 and may be an image such as text, a picture, a moving picture, or the like.

1 and 2, the wearable electronic device 1 can be used for shooting, telephone, message, social network service (SNS), navigation, , Search, and so on.

The functions of the wearable electronic device 1 may be various functions in addition to the functions described above according to the provided modules.

For example, functions that combine two or more functions may be implemented by transmitting a moving image photographed through the camera 110 to the SNS server through the communication unit 140 and sharing the same with other users.

A 3D glasses function for allowing a user to view a stereoscopic image may be implemented in the wearable electronic device 1. [

For example, the external display device alternately displays the left eye image or the right eye image alternately on a frame basis, so that the wearable electronic device 1 can selectively open or shut off the user's binocular to allow the user to feel a stereoscopic effect have.

That is, the wearable electronic device 1 opens the user's left-side shutter when the display device displays the left-eye image, opens the right-eye-side shutter of the user when the display device displays the right- 3-D images can be recognized.

Figures 4 and 5 show another embodiment of the construction of the wearable electronic device in perspective view.

4, the wearable electronic device 1 is provided with only one of the right and left lenses (for example, the right lens 51), so that only one eye can display the wearable electronic device 1 internal display So that an image displayed on the device can be displayed.

5, one eye (e.g., left eye) portion of the user is completely uncovered without being covered by the lens, and only an upper portion of another eye (e.g., right eye) The wearable electronic device 1 may be embodied in a structure that is shielded by the wearable electronic device 1.

The shape and configuration of the above-described wearable electronic device 1 may be selected or changed according to various needs such as the field of use, main function, main use layer, and the like.

Hereinafter, a method of controlling a wearable electronic device according to an exemplary embodiment of the present invention will be described in detail with reference to FIGS.

FIG. 6 is a block diagram of an embodiment of a wearable electronic device according to the present invention. The wearable electronic device 300 includes a control unit 310, a camera 320, a sensing unit 330, A display unit 340, a communication unit 350, and a storage unit 360.

Referring to FIG. 6, the control unit 310 typically controls the overall operation of the wearable electronic device 300 and may include, for example, associated controls for shooting, phone, message, SNS, navigation, And processing. The controller 310 may include a multimedia module (not shown) for multimedia playback. The multimedia module may be implemented in the controller 310 or may be implemented separately from the controller 310.

The control unit 310 includes a camera 320, a sensing unit 330, a display unit 340, a communication unit 350, and a storage unit 350, including one or more processors and a memory for performing the functions described above. And processing the signal input from the controller 360 and analyzing the processed signal.

On the other hand, the camera 320 processes an image frame such as still image or moving image obtained by the image sensor in a video communication mode or a photographing mode, and the processed image frame can be displayed through the display unit 340.

The image frame processed by the camera 320 may be stored in the storage unit 360 or may be transmitted to the outside via the communication unit 350. The camera 320 may be provided at two or more different positions depending on the use environment.

The sensing unit 330 may perform the function of the sensing unit 130 described above.

Meanwhile, the storage unit 360 may store a program for the operation of the control unit 310 and temporarily store input / output data (e.g., a message, a still image, a moving picture, and the like).

The storage unit 360 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk.

The wearable electronic device 300 may also operate in association with a web storage that performs storage functions of the storage 360 on the Internet.

The display unit 340 displays (outputs) information to be processed in the wearable electronic device 300. For example, when the wearable electronic device 300 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. In the video communication mode or the photographing mode, Image, UI, and GUI can be displayed.

1 to 3, the display unit 340 may include an HMD, a HUD (HUD), and a display unit (not shown) to allow the user to visually recognize an object displayed through the display unit 340, Or a transparent display method such as TOLED.

The communication unit 350 may include one or more communication modules for enabling the wearable electronic device 300 to perform data communication with the external device 400 and may include, for example, a broadcast receiving module, a mobile communication module, An Internet module, a local area communication module, a location information module, and the like.

The wearable electronic device 300 may further include an interface unit (not shown) serving as a path for communication with all external devices connected to the wearable electronic device 300.

The interface unit receives data from an external device or supplies power to each component in the wearable electronic device 300 or allows data in the wearable electronic device 300 to be transmitted to an external device.

For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit.

The identification module is a chip for storing various information for authenticating the usage right of the wearable electronic device 300. The identification module includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Thus, the identification device can be connected to the wearable electronic device 300 through the port.

In addition, the interface may be a path through which power from the cradle is supplied to the wearable electronic device 300 when the wearable electronic device 300 is connected to an external cradle, Various command signals may be transmitted to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

Meanwhile, the wearable electronic device 300 may further include a power supply unit (not shown) that receives external power and internal power under the control of the control unit 310 and supplies power required for operation of the respective components have. The power supply unit may include a system capable of charging using solar energy.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof. According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 360 and executed by the control unit 310. [

Hereinafter, a mounting electronic device and a control method thereof according to an embodiment of the present invention will be described in more detail based on the configuration of the wearable electronic device 300 described above.

The camera 320 can photograph the foreground recognized by the user's eyes in accordance with the line of sight of the wearer wearing the wearable electronic device 300. [ In this case, the camera 320 can generate an image corresponding to the foreground (hereinafter referred to as a real image) recognized by the user's viewpoint in accordance with the user's gaze.

The control unit 310 analyzes the real image photographed through the camera 320, recognizes an area where the object is rapidly changed in the real image through the image recognition, and recognizes the wearable electronic device 300 closest to the recognized region, It is possible to automatically select a real image photographed by the photographing apparatus 100 as a sub-image. For example, if the user watches sports, he / she can recognize the place where the ball is located and automatically make a real image photographed by the wearable electronic device 300 closest to the place.

In addition, the control unit 310 can automatically record metadata such as a tag in a real image photographed at a time when a cheering is great through voice recognition.

Further, the control unit 310 may control the communication unit 350 to transmit the photographing position to another wearing electronic device, a terminal device such as a smart phone, or the like. In this case, when the user of the terminal device such as another wearable electronic device, smart phone, or the like transmits the view request to the terminal device 300 wearing the wearer's body based on the photographing position, Or a real image requested by a user of a terminal device such as a smart phone to a terminal device such as another wearable electronic device 300 or a smart phone. In this case, a user of a terminal device such as another wearable electronic device, a smart phone or the like can display a real image transmitted to an auxiliary image, a sub-image, or the like using his / her own device. If the real image photographer requests to store (delete) a scene (privacy intrusion scenes, etc.) that the real image photographer does not want to store for privacy protection, the control unit 310 transmits a delete message, .

In addition, when a real image photographed by a terminal device such as another wearable electronic device or a smart phone is received, the display unit 340 may display the received real image as at least one of the main image, the sub-image, and the auxiliary image.

7 is a diagram illustrating a content providing system according to an embodiment of the present invention. Referring to FIG. 7, according to an embodiment of the present invention, a wearer's electronic device 300 of a photographer and a smartphone can cooperate with each other to network. That is, the image of the photographer A is photographed by the spectacles of the photographer A and transmitted to the smartphones of the photographers B and C through 4G or the like via the smart phone, and the photographer B transmits the images of the photographers A and C to the photographer B Or by using Bluetooth, Wifi, or the like to transmit them to their own smart glasses and watch them in smart glasses together with their photographed images. External viewers at remote locations can also receive and view video.

On the other hand, the server can automatically record metadata such as tags on a video scene based on the comments of viewers. You can also display key scenes with a certain number of point-in-time comments. Viewers can be automatically registered according to the recommended number by recommending them as " good " and registered as a video scene tag. The viewers can record the video scenes selected as the sub-images (the viewers who are not shooting with the wearable electronic device as the sub-images). View image of the photographers as one set (file, folder), and then the viewer can select any of the recorded contents to view.

8 is a view showing an example of using a terminal device for mounting according to an embodiment of the present invention. Referring to FIG. 8, a smart spectacle wearer collaborates with a plurality of people in a sports game, a performance show, etc., so that they can photograph and integrate and share images at various positions and angles. Individuals wearing smart glasses can broadcast and share in real time. A plurality of photographers wearing smart glasses transmit their photographed positions, and when a viewer selects the photographed images, the photographed images are transmitted to the viewer so that the smart glasses of the viewer or the terminal can display the images transmitted through the auxiliary image and the sub-image. The position of a plurality of photographers wearing smart glasses can be transmitted to viewers and other photographers. Here, FIG. 8 shows an example in which each individual is cooperatively broadcasted in a soccer field, and can be photographed and broadcasted in cooperation with the photographers A to D of the audience.

9 is a diagram illustrating a control method of a terminal device for mounting according to an embodiment of the present invention. Referring to FIG. 9, a screen can be displayed to the visitor A wearing smart glasses, as shown in FIG. The viewer A can watch the displayed sub-image and the auxiliary image while viewing the real image A.

The smart glasses of the viewer A displays the images captured by the other smart-eye spectators other than the real image A as auxiliary images (the captured images of the C and D viewers are displayed as auxiliary images), and the viewer A displays the real images The auxiliary image and the sub-image can be viewed. The sub-image may be transmitted and received in a larger and clear image quality than the sub-image when the user selects the sub-image. In the above, the viewer A selects a B image viewed and photographed by the B viewer from among the auxiliary images of the B through D spectators, and the selected B image can be viewed as a sub-image by receiving the clearer image quality from the B viewer.

On the other hand, a plurality of spectator photographers transmit only their photographing positions, and a viewer must select a sub-image or a sub-image to receive the sub-image or the sub-image. The position of a large number of viewers' photographers can be represented as an auxiliary image together with a stadium and a venue image so that a user can intuitively know a photographing position.

10 is a diagram illustrating a control method of a terminal device for mounting according to an embodiment of the present invention. Referring to FIG. 10, when a viewer and another photographer request a specific photographer to perform a desired photographing action by chatting, display on an image, or the like, a specific photographer can take a photographing action by moving his gaze in response to the suggestion in real time. In this case, as shown in FIG. 10, the viewer D can request the viewer A to display the center position desired by the viewer A to photograph the captured image of the viewer A. The request can be transmitted through voice or text chat, and can be transmitted by displaying the captured image of A through a voice command, a touch command, an operation recognition command, a sight recognition command, or the like.

11 is a diagram illustrating a control method of a terminal device for mounting according to an embodiment of the present invention. Referring to FIG. 11, the photographing request of the visitor D can be transmitted to the visitor A and displayed. If A moves his gaze in response to the request of D, he can be photographed and shared as it is.

Meanwhile, according to an embodiment of the present invention, when the shot image is shared, the shot image is not transmitted as it is, and effects (such as a snowing effect, a fog / halo effect, a background color change, The subject can be transferred (supervised by the photographer).

In addition, according to an embodiment of the present invention, sub-images (main image in the case of an external viewer, not a photographer) among the sub-images can be automatically selected. In this case, it can be selected according to the preference of the user or according to the past habit data. Alternatively, an image in which the object of the photographed image suddenly changes among the auxiliary images can be automatically selected as a sub-image through image recognition. For example, in sports, the image of the photographer closest to the place where the ball is located may automatically become a sub-image.

Also, according to an embodiment of the present invention, metadata (e.g., tags such as "Park Ji-sung Shoot!") Such as a tag on an image of a scene with a large accent can be automatically recorded through speech recognition and image recognition. Based on the comments of viewers, it is possible to automatically record metadata such as tags on the video scene. It also displays key scenes with a certain number of comments. Viewers are referred to as "Likes", etc. The viewers can record the sub-images (the users who are not photographed with the smart glasses are still in the sub-image) and the scenes selected as the sub-images can be scored and recorded.

In addition, according to one embodiment of the present invention, when a photographer requests to store (delete) a scene (privacy invasion scene, etc.) which the photographer does not want to store, the deletion message is transmitted, Lt; / RTI >

Also, according to an embodiment of the present invention, the multi-view images of the photographers are stored as one set (file, folder), and the viewer can select any of the recorded contents to view.

Meanwhile, the method according to various embodiments of the present invention described above may be implemented in program code and provided to each server or devices in a state stored in various non-transitory computer readable media.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

300: wearable electronic device 310:
320: camera 330: sensing unit
340: display unit 350: communication unit
360: storage unit 400: external device

Claims (8)

In a wearable electronic device,
A transparent or light transmissive lens unit;
A camera unit for photographing a foreground recognized by the smart glasses wearer;
A communication unit for transmitting position information of the wearable electronic device;
When a request signal requesting foreground photographed by the wearable electronic device is received from the terminal device according to the transmitted positional information, the communication device transmits the image corresponding to the foreground photographed by the wearable electronic device to the terminal device, And a control unit for controlling the electronic device. The method according to claim 1,
Wherein,
And a foreground photographing request signal different from the foreground photographing is received from the terminal device. In a wearable electronic device,
A transparent or light transmissive lens unit;
A camera unit for photographing a foreground recognized by the smart glasses wearer;
A communication unit for receiving an image photographed by the at least one terminal device from at least one terminal device;
A display unit for displaying a display image on the lens unit; And
And a control unit for controlling the display unit to display a foreground image corresponding to the photographed foreground and an image photographed at the at least one terminal apparatus. The method of claim 3,
Wherein,
Displaying the foreground image as a main image,
And controls the display unit to display an image photographed by the at least one terminal device as an auxiliary image. A control method of a wearable electronic device having a transparent or light transmissive lens portion,
Photographing a foreground recognized by the smart spectacle wearer;
Transmitting location information of the wearable electronic device;
Receiving from the terminal device a request signal requesting a foreground photographed by the wearable electronic device according to the transmitted location information;
And transmitting the image corresponding to the foreground photographed by the wearable electronic device to the terminal device. 6. The method of claim 5,
And receiving a foreground photographing request signal different from the photographed foreground from the terminal device. A control method of a wearable electronic device having a transparent or light transmissive lens portion,
Photographing a foreground recognized by the smart spectacle wearer;
Receiving an image photographed by the at least one terminal device from at least one terminal device;
Displaying a foreground image corresponding to the photographed foreground and an image photographed by the at least one terminal apparatus on the lens unit. 8. The method of claim 7,
Wherein the displaying comprises:
Displaying the foreground image as a main image,
Wherein the control unit controls the display unit to display an image photographed by the at least one terminal device as an auxiliary image.

Images