JP6246334B2 - Electronic device, electronic device control method, and program - Google Patents

Description

  More particularly, the present invention relates to an electronic device that performs image processing, a control method for the electronic device, and a program.

  With the development of electronic technology, various electronic devices have been developed and spread. In particular, electronic devices such as state-of-the-art smartphones and smart glasses based on excellent IT technology are also in widespread use.

  In recent years, demand for cutting-edge electronic devices is increasing due to price cuts and performance improvements of cutting-edge electronic devices. Along with this, efforts to develop convenient and diverse usage methods according to state-of-the-art electronic devices have been accelerated.

  As a result, development of various applications is required for the convenience of users who use electronic devices.

  The present invention has been made in accordance with the above-described need, and the present invention generates an image having a contour and an adjusted transparency for a specific image, and the generated image is compatible with live view shooting. It is an object of the present invention to provide an electronic device that displays a photographed image to be displayed, a control method for the electronic device, and a program.

  In order to achieve the above object, a method of controlling an electronic device according to an embodiment of the present invention includes: a step of selecting a specific image; and an image having a contour and a transparency with respect to the selected image. Generating an adjusted first image; and displaying the generated first image overlaid with a captured image corresponding to live view shooting of the electronic device.

  An electronic device according to an embodiment of the present invention for achieving the above-described object includes an imaging unit, a display unit that displays a screen, and an input unit that receives a user input to select a specific image. Then, a first image having an outline and an adjusted transparency is generated for the selected image, and the generated first image corresponds to live view shooting of the electronic device. And a control unit that controls the display unit so as to overlap the captured image.

  A program for causing a computer to execute a control method for an electronic device according to an embodiment of the present invention for achieving the above-described object, wherein the control method selects a specific image; and A step of generating a first image having an outline and an adjusted transparency for the selected image, and the generated first image corresponds to live view shooting of the electronic device. And displaying the image superimposed on the captured image.

  According to another aspect of the present invention, there is provided a method for controlling electronic glasses according to an embodiment of the present invention, comprising: a step of receiving a user input for selecting an image to be copied; On the other hand, a step of generating a first image having a contour line and an adjusted transparency, and displaying the generated first image superimposed on a foreground recognized by the eyewear of the wearer of the electronic glasses. Including the steps of:

  In addition, an electronic glasses according to an embodiment of the present invention for achieving the above-described object includes a display unit that provides a display effect on a foreground recognized by the eye of the wearer of the electronic glasses, and an image for which a copy is desired. An input unit that receives an input of a user who selects the image, and a first image having a contour and an adjusted transparency with respect to the selected image, and the generated first image And a control unit that controls the display unit so as to overlap the foreground recognized by the eye of the wearer of the electronic glasses.

  Also, a program for causing a computer to execute a control method of electronic glasses according to an embodiment of the present invention for achieving the above-described object, wherein the control method receives a user input for selecting an image desired to be copied. Receiving the selected image, generating a first image having a contour and an adjusted transparency, and wearing the generated first image on the electronic glasses. Displaying on the foreground recognized by the person's vision.

  According to the various embodiments of the present invention described above, the captured image and the image-processed first image (having an outline and an adjusted transparency with respect to the specific image) are superimposed on the displayed screen. Both can be displayed. Thus, the user can easily copy a picture displayed on a medium such as paper while viewing the displayed screen. In other words, the user can obtain the same effect as that obtained by copying a picture by applying a transparent film or oil paper to the electronic device.

  According to various embodiments of the present invention, a picture that anyone wants to draw can be easily copied. For example, you can easily copy anything as long as you have a visual source (image), such as your favorite star, the car you want, your family photo, scenery, bromide, or music. At this time, not only can the sketch be made along the contour line, but also the brightness and darkness expression and coloring can be achieved by adjusting the transparency of the third image with respect to the original image.

1 is a block diagram illustrating an electronic device according to an embodiment of the present invention. FIG. 2 is a block diagram specifically illustrating the electronic device according to FIG. 1. 1 is a diagram illustrating an example of a UI (User Interface) screen for explaining a control method of an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example of a UI (User Interface) screen for explaining a control method of an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example of a UI (User Interface) screen for explaining a control method of an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example of a UI (User Interface) screen for explaining a control method of an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example of a UI (User Interface) screen for explaining a control method of an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example of a UI (User Interface) screen for explaining a control method of an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example of a method of drawing a picture using an electronic device according to an embodiment of the present invention. 1 is a diagram illustrating an example in which an electronic device according to an embodiment of the present invention is implemented as a smart glass. 3 is a flowchart for explaining a control method of an electronic device according to an embodiment of the present invention. 6 is a flowchart illustrating a method for generating a first image having a contour and an adjusted transparency according to an exemplary embodiment of the present invention. 6 is a flowchart illustrating a method for generating a first image having a contour and an adjusted transparency according to an exemplary embodiment of the present invention. 1 is a diagram illustrating an example of a method of drawing a picture using a wearable electronic device according to an embodiment of the present invention.

  The following merely illustrates the principles of the invention. Accordingly, those of ordinary skill in the art will be able to invent various devices that embody the principles of the present invention and fall within the concept and scope of the present invention, even if not explicitly described or illustrated herein. In addition, all conditional terms and embodiments listed herein are in principle intended only to assist in understanding the concepts of the present invention, and thus specifically recited embodiments and conditions. It should be understood that the invention is not limited to this.

  It is also to be understood that any detailed description not only of the principles, aspects, and embodiments of the present invention, but also specific embodiments, is intended to include structural and functional equivalents of such matters. I have to. In addition, it should be understood that such equivalents include not only presently known equivalents but also equivalents to be developed in the future, that is, any element invented to perform the same function regardless of structure.

  Thus, for example, the block diagrams herein should be understood as showing conceptual views of exemplary circuits embodying the principles of the invention. Similar to this, all flowcharts, state transformation diagrams, pseudo code, etc. can be shown substantially on a computer readable medium, whether or not the computer or processor is clearly shown, It should be understood to illustrate the various processes performed by a computer or processor.

  The functions of the various elements illustrated in the drawings, including functional blocks represented by a processor or similar concept, are provided through the use of hardware capable of executing software on appropriate software as well as dedicated hardware. Can be done. When provided by a processor, the above functionality can be provided by a single dedicated processor, a single shared processor, or multiple individual processors, some of which can be shared.

  Also, the explicit use of terms presented in the processor, control, or similar concepts should not be construed exclusively by reference to hardware capable of executing software, but is not limited thereto. It should be understood to implicitly include digital signal processor (DSP) hardware, ROM (Read Only Memory) for storing software, RAM, and non-volatile memory. Other hardware known and conventional can also be included.

  In the claims, the components expressed as means for performing the functions described in the detailed description include all types of software including, for example, combinations of circuit elements that perform the functions or firmware / microcode. It is intended to include all methods of performing the function including, and is coupled with appropriate circuitry for executing the software to perform the function. The invention as defined by such claims combines any of the functions provided by the various listed means and is combined with the scheme required by the claims, so any means capable of providing said functions. However, it should be understood that it is equivalent to what is understood from this specification.

  The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Thus, those who have ordinary knowledge in the technical field to which the present invention belongs can easily implement the technical idea of the present invention. Further, in describing the present invention, when it is determined that a specific description of the known technology may obscure the gist of the present invention, a detailed description thereof will be omitted.

  Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram illustrating an electronic device according to an embodiment of the present invention. Referring to FIG. 1, the electronic device 100 includes a display unit 110, an input unit 120, a control unit 130, a storage unit 140, a communication unit 150, and a photographing unit 160.

  Here, the electronic device 100 includes a digital camera having a camera function, a smartphone, a tablet computer, a notebook computer, a PDA (personal digital assistant), a PMP (portable multimedia player), a digital TV, a smart glass, a project glass, and the like. It can be embodied as various devices.

  The display unit 110 has a function of displaying a screen. In particular, when an application (for example, a transcription application) for implementing various embodiments of the present invention is executed, the display unit 110 can display the screens shown in FIGS. 3 to 9.

  Here, the display unit 110 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a flexible display. (3D display), transparent display, HUD (Head Up Display), HMD (Head Mounted Display), and Prism Project Display.

  The input unit 120 receives input from a user who operates the electronic device 100.

  Here, the input unit 120 includes various button forms, a touch sensor that receives a touch input to the display unit 110, a proximity sensor that receives a close approach without directly connecting to the surface of the display unit 110, and a user's voice input. Can be implemented using at least one of the microphones that receive the signal. However, the present invention is not limited to this, and may be embodied in any form capable of receiving user input.

  The storage unit 140 has a function of storing various data and applications necessary for the operation of the electronic device 100. In particular, the storage unit 140 may store a “copying application” for implementing various embodiments of the present invention.

  Here, the storage unit 140 includes a RAM (Random Access Memory), a flash memory, a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electronically Erasable and Programmable ROM, a hard disk register, a hard disk register, a hard disk). In addition to a built-in storage element such as a storage device, it may be implemented as a removable storage element such as a USB memory.

  The communication unit 150 enables communication between the electronic device 100 and an external device. Here, the communication unit 150 is connected in a wireless or wired manner via a local area network (LAN) and the Internet network, connected via a USB (Universal Serial Bus) port, 3G A form connected via a mobile communication network such as 4G, a form connected via a short-range wireless communication method such as NFC (Near Field Communication), RFID (Radio Frequency Identification), and Wi-Fi are possible.

  The photographing unit 160 can generate an image by photographing a subject. In particular, the photographing unit 160 can generate an image by live view photographing of a subject. Here, the live view shooting means that the user performs shooting while checking the display unit 110 that displays an image shot by the electronic apparatus 100 in real time. Meanwhile, the photographing unit 160 can provide the generated photographed image to the control unit 130.

  The control unit 130 controls the overall operation of the electronic device 100. In particular, the control unit 130 can control all or part of the display unit 110, the input unit 120, the storage unit 140, the communication unit 150, and the imaging unit 160 in cooperation with the executed “copying application”. .

  Specifically, when one drawing mode is selected from among a plurality of drawing modes, the control unit 130 controls the overall operation of the configuration of the electronic apparatus 100 so as to perform an operation corresponding to the selected drawing mode. can do. Here, the drawing modes are “character drawing mode”, “photographing after-drawing drawing mode”, “gallery photo drawing mode”, “animal / plant drawing mode”, “transportation drawing mode”, “person drawing drawing mode”. , At least one of “Precise description mode” can be included. Here, when the “photographing post-shooting drawing mode” is selected, the photographing unit 160 is driven, and image processing can be performed on a photographed image generated by photographing by the photographing unit 160. In other drawing modes, image processing can be performed after a specific image is selected from images stored in advance. In the “precise description mode”, image processing can be performed after shooting or after selecting a specific image.

  That is, after the above-described drawing mode is selected, an image that the user desires to copy can be selected. Here, the image that the user desires to copy may be an image stored in advance in the storage unit 140, an image generated by shooting by the shooting unit 160, or the communication unit 150. May be an image received from an external device.

  On the other hand, when an image that the user of the electronic apparatus 100 desires to copy is selected by the above-described operation, the control unit 130 has a first contour that has an outline and the transparency is adjusted with respect to the selected image. Images can be generated.

  For example, the first image includes a second image generated by extracting a contour line in the selected image, and a third image generated by adjusting the transparency in the selected image. , Can be generated. In other words, the first image may be an image in which the outline of the image selected by the user and the image whose transparency is adjusted appear to be perfectly overlapped.

  At this time, the control unit 130 can generate a second image obtained by extracting a contour line in the selected image. For example, the control unit 130 can extract a contour line by extracting a region in which the pixel value changes beyond a preset size in the selected image. However, this is only one embodiment, and using various known contour extraction algorithms, contour lines for various objects included in the selected image are extracted, and only the extracted contour lines are used. A constructed second image can be generated. Then, the control unit 130 can generate a third image in which the transparency in the selected image is adjusted. For example, when the input of the user who operates the transparency level is not received separately, the control unit 130 applies the A (ALPHA) value corresponding to the default transparency level among the RGBA values of the selected image. Thus, the third image can be generated. Here, the default transparency level can be set to a different level by default according to a plurality of drawing modes.

  Alternatively, when the input of the user who operates the transparency level is received, the control unit 130 applies the A (ALPHA) value corresponding to the selected transparency level among the RGBA values of the selected image. By doing so, a third image can be generated.

  Here, the user's input for manipulating the transparency level may be performed before the step of generating the first image, for example, in the process of selecting the picture by the user. Alternatively, after the step of generating the first image, for example, the first image may be generated and displayed on the display unit 110.

  In addition, the sizes of the generated second image and the third image may be the same, but are not limited thereto.

  Meanwhile, the controller 130 may generate the first image by combining the generated second and third images. Here, the transparency of the generated first image is adjusted by adjusting the color and brightness of the second image including only the outline of the selected image and the selected original image. The third image can be combined with the third image.

  On the other hand, the transparency of the contour line can also be adjusted. For example, when the input of the user who operates the transparency level is not received separately, the control unit 130 can generate a contour line corresponding to the default transparency level. Alternatively, when the input of the user who operates the transparency level is received, the control unit 130 can generate the contour line so as to correspond to the selected transparency level.

  In addition, as described above, it has been described that the transparency is adjusted by adjusting the A (ALPHA) value of the RGBA values. However, this is only an embodiment, and various methods for adjusting the transparency are available. Can be used.

  In addition, as described above, the case where the first image is generated by combining the generated second and third images has been described as an example, but the present invention is not limited to this. According to another example, the first image can be generated only by image processing on the selected image without the step of generating the second and third images. That is, according to another example, the controller 130 may generate the first image by extracting / generating a contour line from the selected image and adjusting the transparency. On the other hand, the control unit 130 can control the display unit 110 so that the generated first image and the captured image generated by the live view shooting of the shooting unit 160 are displayed in an overlapping manner. Specifically, the control unit 130 arranges the captured image generated by the live view shooting of the imaging unit 160 in the lower layer, and arranges the generated first image in the upper layer and displays it together. 110 can be controlled. Here, on the basis of the (+) direction of the Z axis, which is the direction in which the surface of the display unit 110 is directed, a layer disposed above is defined as an upper layer, and a layer disposed below the upper layer is defined as a lower layer. .

  However, this is only one embodiment of the present invention, and according to another embodiment, the control unit 130 generates a shot image generated by live view shooting of the shooting unit 160 in an upper layer and is generated. The display unit 110 can be controlled so that the first image is arranged in a lower layer and displayed together.

  As a result, a drawing screen in which the “photographed image” and the “first image having the contour line and the transparency adjusted” overlap each other can be displayed on the display unit 110.

  On the other hand, according to an embodiment of the present invention, the user can set the transparency adjustment target, the transparency level, the size of the first image displayed overlapping the captured image generated by the live view shooting, and the automatic focus ON / OFF. Can be set. Here, the transparency adjustment target can include a region excluding the contour line included in the displayed first image or the contour line included in the first image.

  For example, the drawing screen displayed on the display unit 110 includes a first area for selecting a transparency adjustment target, a second area for selecting a transparency level, and automatic focus ON / OFF control for shooting. A third area for having the user select the item can be included.

  If an area excluding the outline included in the first image is selected in the first area and the transparency level is adjusted in the second area, the control unit 130 causes the selected transparency level to be selected. To generate a third image. Thereby, the display unit 110 can display both the “photographed image” and the “first image having transparency corresponding to the selected transparency level”. That is, only the third image is affected by the selected transparency level, and the second image is not affected by the selected transparency level.

  If the outline included in the first image is selected in the first area and the transparency level is adjusted in the second area, the controller 130 may select the first level based on the selected transparency level. 2 images are generated. Thereby, the display unit 110 can display both the “photographed image” and the “first image having the contour transparency corresponding to the selected transparency level”. That is, only the second image is affected by the selected transparency level, and the third image is not affected by the selected transparency level.

  On the other hand, in a state in which both the photographed image obtained by Live View photographing of the photographing unit and the first image are displayed, pinch-in or pinch-out with two fingers on the displayed screen. When the input of the user performing the operation is received, the control unit 130 may control the display unit 110 to display the first image with an enlarged or reduced size. At this time, only the size of the first image may be adjusted, or both the first image and the captured image may be enlarged or reduced.

  Meanwhile, the size of the captured image and the first image may be the same. However, it is not limited to this. Further, the first image and the captured image can be displayed so as to overlap the entire screen of the display unit 110.

  On the other hand, when the above-described “precise drawing mode” is selected, the control unit 130 divides the generated first image into a plurality of regions and displays the first image together with a captured image corresponding to live view shooting of the electronic device. Thus, the display unit 110 can be controlled. In this case, when one area is selected from the plurality of areas, the control unit 130 enlarges the selected area and displays the selected area together with a captured image corresponding to live view shooting of the electronic device. Can be controlled. In addition, the control unit 130 can control the storage unit 140 to store the generated first image. Here, the control unit 130 can control the storage unit 140 to store the generated first image in a folder different from the folder in which the original image to be processed is stored.

  In addition, when a user exchange / transaction command for the generated first image is received through the input unit 120, the control unit 130 transmits the generated first image to the image exchange / transaction server. The communication unit 150 can be controlled.

  For example, the image exchange / transaction server may provide a web, a mobile web, a smartphone web, or the like for exchanging / trading images. Through the web, mobile web, or application for exchanging / trading such images, the supplier can provide the original image for free / paid, and the user can use the present invention. The first image can be generated and copied by directly downloading the image that the user wants to copy with the device provided with the application. In such a web or mobile web, a supplier and a consumer can interact to freely exchange / trade images for copying. For example, if a person who is good at a picture uploads his picture to the web or the mobile web, a person who likes the picture and wants to copy it can download it from the web or the mobile web.

  For such operations, an application for implementing various embodiments of the present invention must be provided.

  In order to perform all such operations, a user must basically have an electronic device that is registered with the site and provided with applications for implementing various embodiments of the present invention.

  In addition, the picture supplier does not have to have an electronic device provided with an application for embodying various embodiments of the present invention. Etc.), and the procedure is not required when registering for free sales. When paying sales registration, the supplier has commercial rights, so as a protection mechanism, a semi-transparent stamp mark on the web / mobile web, and a right mouse click as an image copy prevention function on the homepage And a control key / shift key prohibiting function. In addition, when paying by registering for paid sales, payment by credit card or mobile phone authentication is possible, and the image exchange / transaction server that provides the web / mobile web automatically collects a predetermined fee after , You can transfer the sales price to the supplier's account. Announcements can be included in the Terms and Fees for such comprehensive matters. A separate administrator page can control all of the above features such as web / mobile web category adjustment and commenting, notification features, etc.

  On the other hand, the user can download the image, for example, after inputting the number of the smartphone that takes down the image for copying.

  According to such various embodiments of the present invention, a user can easily copy a picture displayed on a medium such as paper while viewing the displayed screen. That is, the user can obtain an effect similar to that of drawing a picture by applying a transparent film or oil paper to the electronic device.

  FIG. 2 is a block diagram specifically illustrating the electronic device according to FIG. Referring to FIG. 2, the electronic device 100 includes a display unit 110, an input unit 120, a control unit 130, a storage unit 140, a communication unit 150, a photographing unit 160, a recognition unit 170, a speaker 180, and external input ports 190-1. 190-n, including all or part of the power supply unit 195. Hereinafter, an overlapping description of the configuration already described with reference to FIG. 1 will be omitted, and the electronic apparatus according to an embodiment of the present invention will be described more specifically with reference to FIG.

  The input unit 120 receives a user operation on the electronic device 100. Here, the input unit 120 includes all or part of various types of sensors such as the touch sensor 121, the geomagnetic sensor 122, the acceleration sensor 123, the bend sensor 124, the pressure sensor 125, the proximity sensor 126, and the grip sensor 127. Can do.

  The touch sensor 121 may be implemented as an electrostatic type or a pressure sensitive type. The electrostatic type uses a dielectric coated on the surface of the display unit 110 to detect fine electricity excited by the user's human body when a part of the user's body touches the surface of the display unit 110. This is a method for calculating touch coordinates. The pressure-sensitive type includes two electrode plates, and when the user touches the screen, the touch coordinates are calculated by detecting the current flowing through the contact of the upper and lower electrode plates at the touch point. As described above, the touch sensor 121 can be implemented in various forms.

  The geomagnetic sensor 122 is a sensor for detecting the rotation state and moving direction of the electronic device 100, and the acceleration sensor 123 is a sensor for detecting the degree of inclination of the electronic device 100. The geomagnetic sensor 122 and the acceleration sensor 123 may be used for detecting the rotation state or the inclination state of the electronic device 100.

  The bend sensor 124 is a sensor necessary when the electronic device 100 is embodied as a flexible display device, and can detect the bending state of the electronic device 100.

  The pressure sensor 125 detects the magnitude of the pressure applied to the electronic device 100 when the user performs a touch or bending operation, and provides the detected pressure to the control unit 130. The pressure sensor 125 may include a piezoelectric film that is built in the display unit 110 and outputs an electrical signal corresponding to the magnitude of pressure. Although FIG. 2 illustrates that the pressure sensor 125 is different from the touch sensor 121, when the touch sensor 121 is embodied as a pressure-sensitive touch sensor, the pressure-sensitive touch sensor serves as the pressure sensor 125 together. You can also

  The proximity sensor 126 is a sensor for detecting a movement approaching without being in direct contact with the surface of the display. The proximity sensor 126 forms a high frequency magnetic field and detects a current induced by a magnetic field characteristic that changes when an object approaches, a high frequency oscillation type that detects a current, a magnetic type that uses a magnet, and a capacitance that changes due to the approach of an object. It can be embodied as various types of sensors such as a capacitance type.

  The grip sensor 127 is a sensor that is disposed in a frame or a handle portion of the electronic device 100 separately from the pressure sensor 125 and detects a user's grip. The grip sensor 127 can be embodied as a pressure sensor or a touch sensor.

  The control unit 130 analyzes various detection signals detected by the input unit 120 to grasp the user's intention, and performs an operation according to the intention. As an example of the operation performed by the control unit 130, processing the data obtained by communication with an external device or the data stored in the storage unit 140, and outputting the data via the display unit 110, the speaker 180, and the like Can do. At this time, the control unit 130 can communicate with an external device using the communication unit 150.

  The communication unit 150 is configured to communicate with various types of external devices using various types of communication methods. The communication unit 150 may include all or part of various communication modules such as the broadcast receiving module 151, the short-range wireless communication module 152, the GPS module 153, and the wireless communication module 154. Here, the broadcast receiving module 151 is a terrestrial broadcast receiving module (not shown) including an antenna, a demodulator, and an equalizer for receiving a terrestrial broadcast signal, and for receiving and processing a DMB broadcast signal. A DMB module can be included. The short-range wireless communication module 152 is a module for performing communication with an external device located at a short distance by a short-range wireless communication method such as NFC (Near Field Communication), Bluetooth, or ZigBee method. The GPS module 153 is a module for receiving a GPS signal from a GPS satellite and detecting the current position of the electronic device 100. The wireless communication module 154 is a module that communicates by being connected to an external network in accordance with a wireless communication protocol such as WiFi or IEEE. In addition, the communication module 152 is connected to a mobile communication network according to various mobile communication standards such as 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution) to perform communication. A module may further be included.

  The control unit 130 can perform the operation by selectively activating the components necessary for performing the operation intended by the user among the components of the communication unit 150 described above.

  On the other hand, the control unit 130 can recognize a voice input or a motion input in addition to a bending operation or a touch operation, and can perform an operation corresponding to the input. At this time, the control unit 130 can activate the recognition unit 170.

  The voice recognition unit 170 collects the user's voice and external sound using voice acquisition means such as a microphone (not shown) and transmits the collected voice to the control unit 130. When operating in the voice control mode, the control unit 130 can perform a task corresponding to the voice of the user when the voice of the user matches a preset voice command. Tasks that can be controlled using voice include various tasks such as volume adjustment, channel selection, channel zapping, display attribute adjustment, playback, pause, rewind, fast forward, application execution, menu selection, device turn on / turn off, etc. Can be mentioned.

  On the other hand, the motion recognition unit 170 obtains a user image using image capturing means (not shown) such as a camera, and then provides the image to the control unit 130. When operating in the motion control mode, the control unit 130 analyzes the user's image and performs an operation corresponding to the motion gesture when it is determined that the user has performed a motion gesture corresponding to a preset motion command. . For example, various tasks such as channel zapping, device turn-on / turn-off, pause, play, stop, rewind, fast forward, mute can be controlled by movement. The above-described examples of tasks that can be controlled by voice, tasks that can be controlled by movement, and the like are merely examples, and the present invention is not limited thereto.

  In addition, the external input ports 1, 2 to n (190-1 to 190-n) are connected to various types of external devices, respectively, and can receive various data, programs, control commands, and the like. Specifically, a USB port, a headset port, a mouse port, a LAN port, and the like can be included.

  The power supply unit 195 is a component that supplies power to each component of the electronic device 100.

  Hereinafter, with reference to FIGS. 3 to 9, a scenario of a control method of an electronic device according to an embodiment of the present invention will be described based on a UI (User Interface) screen.

  When the application is executed, first, the display unit 110 may display an initial drive screen 301 as shown in FIG. Thus, the user can intuitively recognize that the executed application is an application that can copy a picture.

  And the display part 110 can display the help screen 401 which shows a use purpose like Fig.4 (a). When an arrow for moving to the next screen is selected, the display unit 110 can display a help screen 402 indicating how to use it as shown in FIG. Here, the help screen 402 showing the usage method can display a method that allows the program to be used more conveniently and usefully using sentences and visual materials (moving images). For example, when “how to use moving picture menu 403” is selected, a moving picture for explaining how to use can be immediately reproduced. (Press the "Back" button to automatically return to the application)

  On the other hand, when the “menu 404 for drawing” is selected, it is possible to proceed to a screen for selecting a plurality of drawing modes.

  Such a help screen as shown in FIGS. 4A and 4B is not displayed when the application is executed in the future when “Don't display this window in the future” is clicked, and a plurality of drawing modes are immediately selected. You can proceed to the screen you want to receive.

  Thereafter, the display unit 110 can display a screen 501 for selecting a plurality of drawing modes as shown in FIG. Here, the screen for selecting a plurality of drawing modes can include a plurality of drawing modes that can be selected by the user. The drawing modes are “character drawing mode 502”, “photographing post-drawing drawing mode 505”, “gallery photo drawing mode 503”, “animal / plant drawing mode 506”, “transportation drawing mode 504”, “portrait drawing” At least one of “mode 507” and “fine description mode” can be included.

  When the “character drawing mode 502” is selected, it is possible to proceed to a screen for selecting various copyrighted character images and a screen for drawing the selected character image. For example, as shown in FIG. 6, a screen 601 on which characters 602, 603, and 604 to be drawn can be selected can be displayed in a left and right slide show form.

  When “post-photographing drawing mode 505” is selected, after the photographing unit 160 is driven to photograph a photograph, the screen can be advanced to a screen for drawing the photographed image.

  When the “gallery photo drawing mode 503” is selected, it is possible to proceed to a screen for selecting an image in the gallery and a screen for drawing the selected image.

  When the “animal / plant drawing mode 506” is selected, it is possible to proceed to a screen for selecting an animal / plant image and a screen for drawing the selected image.

  When the “transportation mode drawing mode 504” is selected, it is possible to proceed to a screen for selecting a transportation mode image and a screen for drawing the selected image.

  When the “portrait drawing mode 507” is selected, it is possible to proceed to a screen for selecting a portrait image and a screen for drawing the selected image.

  When the “precise drawing mode” is selected, it is possible to proceed to a screen for selecting an image to be precisely drawn and a screen for drawing the selected image.

  Here, the screen for drawing is such that the “shooting image corresponding to the live view shooting” and the “first image having the outline and the transparency of the selected image” overlap each other. The screen can be displayed on the screen. Such a drawing screen will be specifically described with reference to FIG.

  Assuming that the photographing unit 160 is shooting live view of a blank sheet, the display unit 110 can display a drawing screen 703 as shown in FIGS. In other words, the drawing screen may display both “the photographed image 704 corresponding to the photographing of the blank sheet” and “the first images 705 and 706 having the outline and the transparency of the selected image”. it can.

  On the other hand, on the drawing screen, a first area 707 for selecting a transparency adjustment target, a second area 702 for selecting a transparency level, and automatic focus ON / OFF control for photographing are selected. A third region 701 may be included. Here, the first area 707 includes an area 707-1 for selecting an outline as a transparency adjustment target, and an area 707-2 for selecting an area excluding the outline as a transparency adjustment target. Can be included.

  If a region excluding the outline included in the first image is selected in the first region 707 and a transparency level is selected in the second region 702, the control unit 130 has the selection. A third image is generated based on the transparency level. As a result, as shown in FIGS. 7A and 7B, the display unit 110 includes the “photographed image 704” and the “contour line, and has the transparency corresponding to the selected transparency level. Images 705, 706 "can be displayed together.

  For example, as shown in FIG. 7B, when the transparency level is 0%, the first image 706 in which only the outline is clearly left can be displayed on the display unit 110 together with the captured image 704.

  If the transparency level is 100% as shown in FIG. 7A, the first image 705 having “the contour line” and “the color and brightness of the original image whose transparency is not adjusted” is taken. It can be displayed on the display unit 110 together with 704.

  On the other hand, although not shown in FIG. 7, if the transparency level is 50%, the display unit displays the first image together with the photographed image with only the original image having a transparency of 50% with a clear outline. 110 can be displayed.

  On the other hand, depending on the situation, the autofocus function of the photographing unit 160 can be an obstacle. That is, the user sees the screen with the autofocus function activated, but the autofocus function allows the user to focus on a hand or pen drawing a picture on a medium such as paper. Can occur. In this case, since the autofocus function can be a factor that hinders the user from drawing a picture on a medium such as paper, the user can select the autofocus ON / OFF control to prevent the factor. it can.

  On the other hand, when the above-described “precise drawing mode” is selected, the display unit 110 divides the first image 801 into a plurality of regions as shown in FIGS. It can be displayed together with a captured image 804 corresponding to live view shooting. If one area 805 is selected from a plurality of areas as shown in FIG. 8B, the display unit 110 enlarges the selected one area 805 as shown in FIG. The region 806 thus displayed can be displayed so as to overlap with a captured image 804 corresponding to live view shooting of the electronic device. Accordingly, the user can copy an area of the image to be copied on a medium such as paper in more detail.

  On the other hand, in FIG. 8, it has been described that when the “precise drawing mode” described above is selected, the selected region is displayed in an enlarged manner, but the present invention is not limited to this. As another example, the user can pinch-in with two fingers on the displayed screen in a state where the captured image obtained by Live View shooting and the first image are both displayed. Alternatively, pinch-out input can be performed. In this case, the first image can be enlarged or reduced. Alternatively, both the first image and the captured image can be enlarged or reduced.

  FIG. 9 is a diagram illustrating an example of a method of drawing a picture using an electronic device according to an embodiment of the present invention. Referring to FIG. 9, the display unit 110 of the electronic apparatus 100 performs live performances of “a hand 902 drawing a picture” and “paper 903 on which a picture copied by the user while viewing the screen of the display unit 110”. It is possible to display a drawing screen in which the “photographed image” photographed by the view photographing and the “first image having a contour line and adjusted in transparency” overlap each other. At this time, the electronic device 100 can be fixed and drawn by the fixing device 901 in order to photograph the user's drawing and drawing with high accuracy.

  As a result, the user can easily copy a picture on a medium such as paper 903 while viewing the screen displayed on the display unit 110. In other words, the user can obtain the same effect as that obtained by copying a picture by applying a transparent film or oil paper to the electronic device.

  FIG. 10 is a view illustrating an example in which an electronic device according to an embodiment of the present invention is embodied as a wearable electronic device. The illustrated wearable electronic device 200 can be manufactured in the form of glasses so as to be positioned close to the eyes of the user, and all or one of the functional block configurations responsible for the functions described in FIGS. 1 and 2. Parts can be included. In the following, a detailed description of the contents described in FIG. 1 and FIG. 2 will be omitted, and various embodiments of the present invention will be characterized by the form of the wearable electronic device that is worn close to the eyes of the user. This will be described in detail with reference to FIG. Here, the wearable electronic device 200 may be embodied as various devices such as smart glasses and project glasses that are worn close to the eyes of the user.

  Referring to FIG. 10 illustrating the shape of the wearable electronic device 200 in front view, the wearable electronic device 200 according to the embodiment of the present invention includes left and right lens frames 10 and 11, a frame connecting portion 20, and left and right cranes. 30 and 31, and left and right lenses 50 and 51.

  On the other hand, a photographing unit 260 capable of taking a photograph or a moving image can be attached to the front surface of the wearable electronic device 200. For example, as illustrated in FIG. Can be arranged.

  Accordingly, the user can take a picture or a moving image by using the photographing unit 260 and store or share it while wearing the wearable electronic device 200 in the form of glasses and moving.

  In this case, there is an advantage that the viewpoint of the video captured by the imaging unit 260 is very similar to the viewpoint of the scene recognized by the user's vision.

  In addition, a gesture such as a user's hand movement can be recognized by the photographing unit 260, and the operation or function of the wearable electronic device 200 can be controlled by the recognized gesture.

  The position or number at which the photographing unit 260 is attached can be changed as necessary, and a special purpose camera such as an infrared camera may be used.

  In addition, units for performing a specific function can be arranged in each of the left and right cranes 30 and 31.

  An input unit 220 that receives user input for controlling the function of the wearable electronic device 200 may be attached to the right side-arm 31.

  For example, a track ball 221 or a touch pad 222 for selecting or moving an object such as a cursor or menu item on the screen may be disposed on the right temple 31.

  The input unit 220 provided in the wearable electronic device 200 is not limited to the trackball 221 and the touch pad 222, and various input devices such as a key pad, a dome switch, a jog wheel, and a jog switch. Can be provided.

  On the other hand, a microphone 223 can be attached to a left side-arm 30, and the operation or function of the wearable electronic device 200 is controlled using the user's voice recognized by the microphone 223. be able to.

  In addition, a sensing unit 224 is arranged on the left temple 30 to detect the current state such as the position of the wearable electronic device 200, the presence / absence of user contact, the direction, acceleration / deceleration, information on the user, etc. A sensing signal for controlling the operation of the wearable electronic device 200 can be generated.

  For example, the sensing unit 224 may be a motion sensor such as a gyroscope or an accelerometer, a position sensor such as a GPS device, a magnetic sensor, or a theodolite. Directional sensors, temperature sensors, humidity sensors, wind direction / air volume sensors, and the like, but the present invention is not limited to this, and in addition to the sensors described above, sensors that can detect various information are further included. Can be included.

  For example, the sensing unit 224 may further include an infrared sensor. The infrared sensor includes a light emitting unit that emits infrared rays and a light receiving unit that receives infrared rays, and can be used for infrared communication, proximity measurement, and the like.

  The wearable electronic device 200 according to an embodiment of the present invention may include a communication unit 250 for communication with an external device.

  For example, the communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, a short-range communication module, and the like.

  In addition, the wearable electronic device 200 according to an embodiment of the present invention may include a display device for displaying an image and transmitting visual information to a user.

  The display device may include a transparent type or a light transmissive type unit so that a user can see a front view that spreads in front of the eyes along with information displayed by the display device. Can do.

  For example, by making at least one of the left and right lenses 50 and 51 shown in FIG. 10 perform the function of the transparent display as described above, the user visually recognizes the text or image formed on the lens. You can recognize and see the foreground.

  For this purpose, the wearable electronic device 200 uses a display device such as HMD (Head Mounted Display), HUD (Head Up Display), or Prism Project Display so that various types of information are displayed in front of the user's eyes. can do.

  The HMD includes a lens that enlarges an image to form a virtual image, and a display panel that is disposed at a position closer to the focal length of the lens. When the HMD is worn near the user's head, the user can visually recognize the virtual image by viewing the video displayed on the display panel through the lens.

  Meanwhile, the HUD is configured such that an image displayed on a display panel is magnified by a lens, the magnified image is reflected by a half mirror, and a virtual image is formed when the reflected light is visible to a user. Yes. Further, since the half mirror transmits external light, the user can see the foreground together with the virtual image formed by the HUD by the external light transmitting through the half mirror.

  The display device may be implemented using various transparent display methods such as TOLED (Transparent OLED).

  On the other hand, in the Prism Project Display, the beam of the mini projector is reflected by the plate in the prism and enters the wearer's eyes, and this light is tied to the macular of the retina of the eye, and the optic nerve transmits this visual information to the brain. As a result, the user can view the video displayed by the Prism Project Display together with the foreground. The wearable electronic device using the Prism Project Display can be a project glass. In this case, unlike the above-described FIG. 10, it is not necessary to include another lens unit.

  Below, although one embodiment of the present invention is described taking the case where wearable electronic device 200 is provided with HUD as an example, the present invention is not limited to this.

  A HUD having a function similar to that of a projector can be attached to the rear surface of at least one of the left temple 30 and the right temple 31.

  The image of the light emitted from the HUD is reflected by the left and right lenses 50 and 51 and is visible to the user, so that the user recognizes that the object formed by the HUD is displayed on the left and right lenses 50 and 51. Can be done.

  On the other hand, unlike FIG. 10, the wearable electronic device 200 includes only one of the left and right lenses (for example, the right lens 51), and the wearable electronic device 200 such as a HUD is provided only in one eye. The video displayed on the display device can be seen.

  Further, one eye (for example, the left eye) of the user is completely covered without being covered with the lens, and only the upper part of the other eye (for example, the right eye) is covered with the lens 11. In other words, the wearable electronic device 200 may be implemented with the structure described above.

  The shape and configuration of the wearable electronic device 200 as described above can be selected or changed according to various needs such as a field of use, a main function, and a main use hierarchy.

  On the other hand, such a display device may have the function of the display unit 110 illustrated in FIGS. However, when the smart glass 200 is used, the photographing unit 260 described with reference to FIGS. 1 and 2 may be used due to the characteristic of the smart glass 200 that the user can wear and see the foreground spreading in front of his / her eyes. Live view shooting operations may be unnecessary (ie, there is no need to display a captured image). That is, a display device such as HUD displays a “transparent first image having a contour line” generated by combining the second and third images described above, so that the wearer can You can see both the displayed information and the foreground spreading in front of you. In this case, the wearer can recognize that a screen similar to the screen illustrated in the display unit 110 of FIG. 9 is displayed on the lenses 50 and 51.

  Thus, the user can more easily copy a picture on a medium such as paper while looking at the screen displayed on the smart glass or the project glass. In other words, drawing while watching a live-view shooting image with an electronic device such as a smartphone causes a delay between the actual hand movement and the hand movement displayed on the screen by shooting. Since the glass or project glass sees the actual hand movement and the first image at the same time, it can perfectly compensate for this drawback.

  That is, when using a device that draws a picture by driving the camera and displaying the first image on the live view screen, such as a smartphone, the actual hand movement and the hand movement on the live view screen. A minute delay occurs between the two. However, in the case of smart glasses or project glasses, it is operated using HUD (Head Up Display), HMD (Head Mounted Display), prism project, prism display, and various display devices defined above, and a live view of the camera. Instead, the actual scene (the foreground video spreading in front of the user's eyes) and the first image can be seen together, so that the user copies the first image while directly looking at his / her own hands. Therefore, there is a great advantage that there is no delay occurring in the live view.

  In addition, in order to use a device such as a smartphone or a digital camera provided with the application of the present invention, there is an inconvenience that it must be placed somewhere in order to fix the device. Is basically placed in front of the user's eyes and is naturally fixed, which is also a great advantage in this respect.

  Meanwhile, according to an embodiment of the present invention, when the electronic apparatus 100 is moved by a user operation, the first image displayed on the display unit 110 is fixed, and only the captured image is compatible with live view shooting. The image can be changed to a captured image and displayed. In other words, the “first image having an outline and adjusted in transparency” is an image that the user desires to copy, and is thus fixed to the screen of the display unit 110 of the electronic device 100. However, the shot image is an image obtained by live view shooting, and since the video shot in real time by the shooting unit changes according to the movement of the electronic device 100, the shot image is changed to a shot image corresponding to live view shooting and displayed. Can do.

  However, this is merely an embodiment of the present invention, and when the electronic device 100 is moved by a user operation according to an embodiment, the first image is moved and displayed so as to correspond to the movement of the electronic device 100. Can be done.

  FIG. 11 is a flowchart illustrating a method for controlling an electronic device according to an embodiment of the present invention. Referring to FIG. 11, first, a specific image can be selected (S1101).

  Then, it is possible to generate a first image having an outline and an adjusted transparency with respect to the selected image (S1102).

  Then, the generated first image can be displayed in a superimposed manner with a captured image corresponding to live view shooting of the electronic device (S1103).

  Here, an example of generating the first image will be specifically described with reference to FIG.

  FIG. 12 is a flowchart for explaining a method of generating a first image having a contour line and adjusted in transparency according to an embodiment of the present invention. Referring to FIG. 12, first, it is possible to generate a second image in which a contour line in the selected image is extracted (S1201).

  Then, a third image in which the transparency of the selected image is adjusted can be generated (S1202).

  The generated second and third images can be combined to generate the first image (S1203).

  On the other hand, in the display step (S1103) described above, the captured image corresponding to the live view shooting of the electronic device is arranged in the lower layer, and the generated first image is arranged in the upper layer to generate the captured image. The first image can be overlaid and displayed (S1204).

  On the other hand, in the displaying step (S1204), a first area for selecting a transparency adjustment target, a second area for selecting a transparency level, and automatic focus ON / OFF control for the photographing are selected. A screen further including a third area for receiving the request can be displayed. At this time, in the step of generating the third image (S1202), the first image is selected based on the transparency adjustment target selected in the first area and the transparency level selected in the second area. Can be generated. Below, the case where the area | region except the outline is selected as transparency adjustment object is demonstrated concretely with reference to FIG.

  FIG. 13 is a flowchart illustrating a method for generating a first image having a contour line and an adjusted transparency according to an exemplary embodiment of the present invention. Referring to FIG. 13, first, the transparency level of the first image displayed to overlap the captured image corresponding to the live view shooting can be selected in the second area (S1301).

  In this case, among the RGBA values of the third image, an A (ALPHA) value corresponding to the selected transparency level can be applied to generate a new third image (S1302).

  Then, a new first image can be generated by combining the third image generated in step S1302 with the second image related to the extracted contour line generated in advance (S1303). ).

  Then, the first image generated in step S1303 can be displayed so as to overlap with a captured image corresponding to live view shooting of the electronic device (S1304).

  On the other hand, in the displaying step (S1204) described above, when the precise depiction menu is selected, the first image can be divided into a plurality of areas and displayed together with the captured image corresponding to the live view shooting of the electronic device. . When one area is selected from the plurality of areas, the selected area can be enlarged and displayed together with a captured image corresponding to live view shooting of the electronic device.

  In addition, the control method according to an embodiment of the present invention may further include a step of storing the generated first image.

  In addition, the control method according to an embodiment of the present invention may further include transmitting the generated first image to the image exchange / transaction server.

  FIG. 14 is a view illustrating an example of a method of drawing a picture using a wearable electronic device according to an embodiment of the present invention. Referring to FIG. 14, the wearable electronic device 200 may be implemented as a project glass, for example. In this case, the user wearing the project glass spreads in front of the user's eyes 1403 while viewing the “first image with the contour line and the adjusted transparency” with the eyes 1403 by the prism project and the prism display. It is possible to see “the hand 1401 drawing a picture” and “paper 1402 on which a picture copied by the user while viewing the first image” as the foreground.

  Accordingly, the user can more easily copy the picture on a medium such as paper using the first electronic image and the foreground image that are visible using the wearable electronic device.

  Meanwhile, the above-described method for controlling an electronic device according to various embodiments of the present invention may be implemented by each server in a state where it is stored in various non-transitory computer readable media embodied in program code. Or it can be provided to the equipment.

  The non-transitory readable medium means a medium that stores data semipermanently and can be read by a device, not a medium that stores data at a short moment such as a register, a cache, or a memory. Specifically, the various applications or programs described above can be provided by being stored in a non-transitory readable medium such as a CD, a DVD, a hard disk, a Blu-ray disc, a USB, a memory card, and a ROM.

  Although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the present invention is not deviated from the gist of the present invention claimed in the scope of claims. It goes without saying that various modifications can be made by those having ordinary knowledge in the technical field to which the invention belongs, and such modifications should not be understood individually from the technical idea and perspective of the present invention.

Claims (11)

An electronic device control method comprising:
Having a specific image selected,
Generating a first image having a contour and an adjusted transparency for the selected image;
Displaying the generated first image superimposed on a captured image corresponding to live view shooting of the electronic device;
Only including,
The generating step includes
Generating a second image obtained by extracting a contour line in the selected image;
Generating a third image with adjusted transparency in the selected image;
Combining the generated second and third images to generate the first image;
Including
In the displaying step,
A first area for selecting a transparency adjustment target, a second area for selecting a transparency level, and a third area for selecting automatic focus ON / OFF control for the photographing. Furthermore, the control method which displays the screen which contains . The transparency adjustment target is
Including at least one of a contour line included in the first image and a region excluding the contour line in the first image;
In the step of generating the first image,
The first region in the selected ask transparency controlled system, to generate the first image based on said second transparency levels were asked to select the region, control method according to claim 1. In the step of generating the first image,
Of RGBA values of the image I was asked to the selection, to generate the first image by applying the A (ALPHA) values corresponding to the transparency levels were asked to the selection, control of claim 1 Method. In the displaying step,
The captured images are arranged in the lower layer, the first image the generated by arranging the upper layer, displays superimposed a first image and the captured image is the product, claims 1 to 3 The control method according to any one of the above. The displaying step includes
When the precise depiction menu is selected, the first image is divided into a plurality of areas and displayed together with a captured image corresponding to live view shooting of the electronic device,
2. The method according to claim 1, further comprising a step of enlarging the selected area when the area is selected from the plurality of areas and displaying the enlarged area on a captured image corresponding to live view shooting of the electronic apparatus. 5. The control method according to any one of items 1 to 4 . Further comprising control method according to any one of claims 1 to 5 the step of transmitting a first image the generated the image replacement / transaction server. An electronic device,
A shooting section;
A display unit for displaying a screen;
An input unit for receiving user input for selecting a specific image;
A first image having an outline and an adjusted transparency is generated for the selected image, and the generated first image is captured corresponding to live view shooting of the electronic device. look including a control unit for controlling the display to display overlaid with the image,
The controller is
A second image obtained by extracting a contour line in the selected image is generated, a third image in which transparency is adjusted in the selected image is generated, and the generated second and second images are generated. 3 images are combined to generate the first image;
The controller is
A first area for selecting a transparency adjustment target, a second area for selecting a transparency level, and a third area for selecting automatic focus ON / OFF control for the photographing. Furthermore, the electronic apparatus which controls the said display part so that the screen containing it may be displayed . The transparency adjustment target is
Including at least one of a contour line included in the first image and a region excluding the contour line in the first image;
The controller is
The electronic device according to claim 7 , wherein the first image is generated based on a transparency adjustment target selected in the first region and a transparency level selected in the second region. The controller is
The electronic device according to claim 8 , wherein the first image is generated by applying an A (ALPHA) value corresponding to the selected transparency level among the RGBA values of the selected image. apparatus. A storage unit,
10. The electronic device according to claim 8 , wherein the control unit controls the storage unit to store the generated third image in another folder for the first image. A program for causing a computer to execute an electronic device control method,
The control method is
Having a specific image selected,
Generating a first image having a contour and an adjusted transparency for the selected image;
A first image said generated viewing including the steps of: displaying overlapping the photographing image corresponding to the live view photographing of the electronic device,
The generating step includes
Generating a second image obtained by extracting a contour line in the selected image;
Generating a third image with adjusted transparency in the selected image;
Combining the generated second and third images to generate the first image;
Including
In the displaying step,
A first area for selecting a transparency adjustment target, a second area for selecting a transparency level, and a third area for selecting automatic focus ON / OFF control for the photographing. A program that displays a screen that further includes it .

Images