KR101525025B1 - Live capturing method in smartphone - Google Patents

Abstract

The present invention relates to a live capturing method in a smartphone. The live capturing method according to the present invention enables capturing a current display screen by a control unit and storing of the captured screen in a memory, wherein the entire current display screen is stored in an image mode, or an image part of the current display screen is stored in an image mode while a text part thereof is stored in a text mode. In addition, a corresponding file stored in a memory is brought to be displayed in a screen of a display unit, wherein when a web address, phone number, or e-mail address in an image of the corresponding file is clicked, a user can be directly connected to the corresponding web site, phone number, or e-mail address. Thus, when a user captures and stores a certain image or text with a related web address, phone number, or e-mail address while using a smartphone and later clicks the web address, phone number, or e-mail address in the image of the stored file, the user can be directly connected to the corresponding web site, phone number, or e-mail address, thereby further providing the user with a convenience in use of a smartphone.

Description

Live capturing method in smartphone}

The present invention relates to a live capturing method in a smart phone, and more particularly, to a smart captioning method for capturing a web address or a telephone number existing in a captured image on a smart phone, ≪ / RTI >

The mobile communication terminal (e.g., a smart phone) can be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function.

Some mobile communication terminals include additional functions to execute games, and other types of mobile communication terminals are also implemented as multimedia devices. In addition, recent mobile communication terminals may receive a broadcast or multicast signal to view a video or a television program.

In order to implement complex functions in multimedia devices, various new attempts have been made in terms of hardware or software. For example, in order to allow a user to easily and conveniently search for or select a function, a user interface environment implemented in various forms is provided.

Furthermore, the development of communication networks has led to a rapid increase in the number of terminals capable of accessing the Internet. Unlike the Internet using the computer, the use of the Internet using the mobile communication terminal is somewhat inconvenient. That is, since the input device is relatively weaker than the computer, the inputting of the information and the processing time are required.

Therefore, in order to view an Internet site frequently used by a user, it is troublesome to repeatedly perform the same procedure every time. That is, there is an inconvenience in that it is required to input a search word in a basic screen state according to a connection, receive a search result, check it again on the output screen, and move to a desired page.

On the other hand, when a user captures an image or text using the capture function of the smartphone while using the smartphone, the captured image or text is converted into a single image data file It is automatically stored in memory. The user can again view the captured image or the imaged text on the display screen as the image (image) captured by the smartphone camera can be viewed again on the display screen of the smartphone. At this time, the image or text displayed on the display screen may consist of only the image or text, but a user who wants to obtain more (or more detailed) information related to the source of the image or text within the image or the text A web address, a telephone number, and an e-mail address may be included together. At this time, when the user wants to connect to the corresponding web address, telephone number, or e-mail address, the user inputs the web address, telephone number, and e-mail address through another window, Lt; / RTI >

As described above, in order to obtain more (or more detailed) information related to the image captured by the user or the text that has been imaged in the current smartphone use environment, the web address, the telephone number, and the e-mail address , It is inconvenient to input the web address, the telephone number, and the e-mail address in a separate window.

Korean Patent Publication No. 10-2013-0127301 (published on November 22, 2013) Korean Patent Publication No. 10-2013-0097485 (published on Mar. 03, 2013)

The present invention has been made in view of the above-mentioned problems, and it is an object of the present invention to provide a method and apparatus for capturing a web address or a telephone number associated with an image or text, The present invention provides a live capturing method in a smart phone that can further facilitate the use of a smart phone by allowing a user to directly connect to a web site or a telephone number when a user clicks a phone number.

According to an aspect of the present invention, there is provided a method of capturing live images in a smartphone,

A control unit for processing data or signals according to a command input through a user input unit or an external remote control, an operating system (OS) for smart phone operation, various application programs, 1. A capturing method in a smartphone including a memory for storing specific data or information and a display unit for displaying a defaultized basic screen according to a smart phone operation and a result of processing by the control unit on a screen,

a) capturing a current display screen by the control unit when a capture instruction by a user's key operation is input through the user input unit while at least one of an image or text is displayed on the screen of the display unit, and storing the current display screen in the memory step; And

b) If an 'import' command is input to the imaged file containing at least one of the image or text stored in the memory by the capture, the control unit may retrieve the file and display it on the screen of the display unit, And attaching it as an attachment file for storage in a different directory or for transmission to the destination,

Wherein the current display screen is captured by the control unit and stored in the memory in step a), the current display screen is stored in the image mode, the image portion of the current display screen is stored in the image mode, Saved in text mode,

In the step b), the control unit retrieves the corresponding file and displays it on the screen of the display unit. If a web address, a telephone number, or an e-mail address in the image of the file is clicked, There is a characteristic in connection.

Herein, the web part, the telephone number, or the e-mail address of the text part may be converted into a clickable form and stored in the image part of the current display screen in the image mode and the text part in the text mode.

At this time, web address, telephone number, or e-mail address of the text part is converted into a clickable form and is stored. Preferably, when a web address, a telephone number, or an e-mail address is clicked, And can be converted into a linkable mode that can be directly connected to the network.

In addition, when a certain portion of the image or text is not linked to the selected portion, the application can be stored in the memory so that the selected portion can be link-translated.

In addition, in the step a), the control unit may store the entire current display screen in the image mode, or store the image portion of the current display screen in the image mode and the text portion in the text mode, And selecting whether to store the entire image in the image mode, the image portion in the current display screen in the image mode, and the text portion in the text mode.

In addition, in the step a), when the current display screen is captured by the controller and stored in the memory, the entire display screen or a certain selection area of the display screen can be stored.

In this case, even in the case of a file in which a certain selection region in the display screen is stored, when the control unit calls the corresponding file and displays it on the screen of the display unit according to the input of the 'load' command in step b) The selection area can be configured to display the corresponding image or the entire text.

In addition, in the step a), when the current display screen is captured by the control unit and is stored in the memory, when the captured object is a business card, the entire business card is directly stored as an image file, It can be stored in the phonebook of the user's smartphone, the email address in the email address book, and the web address in the web address book.

Here, preferably, in capturing by the smartphone, a capture command by a user's key operation for a web address, a telephone number, or an e-mail address called by the other party while the user is communicating with the other party, Capturing a certain portion of the voice call content including the web address, the telephone number, or the e-mail address invoked by the control unit by the control unit, and storing the captured portion in the memory.

In this case, when a certain portion of the voice call content including the web address, the telephone number or the e-mail address called by the other party is captured and stored in the memory, the voice signal for the web address, May be converted into characters and stored.

According to the present invention, a user can capture a web address, a telephone number, or an e-mail address together with an image or text during use of the smart phone and save the file as a file, and later store the web address, When the user clicks an e-mail address, the user can easily provide the convenience of using the smart phone by connecting the e-mail address directly to the corresponding website, telephone number, or e-mail address.

FIG. 1 schematically shows a system configuration of a smartphone to which a live capturing method in a smartphone according to the present invention is applied; FIG.
2 is a flow chart schematically illustrating the execution of a live capturing method in a smartphone according to an embodiment of the present invention;
FIG. 3 is a view showing a capture screen and an image-based capture screen together with an image, which are captured and stored according to a live capturing method in a smartphone according to the present invention.
4 is a view showing a captured screen including only text that is captured and stored according to a live capturing method in a smartphone according to the present invention.
FIG. 5 is a view showing a capture screen including captured images stored in a smartphone according to a live capturing method of the present invention, text, a Web address of a specific site, a web screen configuration, and the like.
FIG. 6 is a view showing an image screen captured by a capture all screen shot function, which is a type of UX / UI that can be introduced in a live capturing method in a smartphone according to the present invention.

The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms and the inventor can properly define the concept of the term to describe its invention in the best way Should be construed in accordance with the principles and meanings and concepts consistent with the technical idea of the present invention.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the terms " part, "" module, "and" device " Lt; / RTI >

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Before describing the embodiments of the present invention, a system configuration of a smart phone to which the present invention is applied will be briefly described first.

FIG. 1 is a diagram schematically showing a system configuration of a smartphone to which a live capturing method in a smartphone according to the present invention is applied.

1, a smartphone 100 includes a sensing unit 110, a capture unit 120, a memory 130, a user user input unit 140, a display unit 150, a communication unit 160, 170, and a control unit 180.

The sensing unit 110 senses the current state of the smartphone 100 such as the location of the smartphone 100, the presence of a user, the orientation of the smartphone 100, acceleration / deceleration of the smartphone 100, And generates a sensing signal for controlling the operation of the smartphone 100.

The capture unit 120 may capture an image, text, or a screen in which an image and text co-exist according to a capture command of the user. The image or text referred to in the present invention may be an image or text existing in the internal memory or an image or text provided from the outside. The capture unit 120 may include a camera 121 and a microphone 122 for inputting a video signal or an audio signal.

The memory 130 may store a program for processing and controlling the control unit 180 (to be described later), and may store input / output data (for example, capture data, a phone book, a message, a still image, For example. In addition, an operating system (OS) and various application programs for smart phone operation may be stored in the memory 130.

The user input unit 140 generates input data for controlling the operation of the smartphone. That is, the user input unit 140 may include a touch type key pad, a touch pad (static pressure / static electricity), and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 150 described later, it can be called a touch screen.

The display unit 150 displays information processed in the smartphone 100 on the screen. For example, the display unit 150 may include a capture panel including a list of captured data captured by the capture unit 120, a list of captured data, a UI associated with a shared panel including a list of identification information of the external device 200 user interface, GUI (graphic user interface), and the like. As described above, when the display unit 150 and the touch pad have a mutual layer structure and are configured as a touch screen, the display unit 150 can be used as an input device in addition to the output device.

The communication unit 160 may include one or more components that enable communication between the smartphone 100 and the external device 200 (e.g., another smartphone, notebook computer, DTV, IPTV, etc.). For example, the communication unit 160 may include a broadcast receiving module, a mobile communication module, a wireless Internet module, a wired Internet module, a short distance communication module, a location information module, and the like.

The recommendation unit 170 may generate the recommended content according to the captured data. The recommendation unit 170 may generate recommendation content including at least one of usage pattern information of the smartphone 100, profile information of the user, and life pattern information of the user. The recommendation unit 170 may be constituted by one component constituting the system, but in some cases, it may be constituted by a separate application rather than a system component, and may be an optional element that can be selected according to the needs of the user .

The control unit 180 controls the operation of the smartphone 100 as a whole. For example, the control unit 180 captures an image, text or voice, and performs control and processing related to voice communication, data communication, video call, and the like. That is, the control unit 180 controls the overall operation of the sensing unit 110, the capture unit 120, the memory 130, the user input unit 140, the display unit 150, the communication unit 160, Can be controlled.

A live capturing method in a smartphone according to the present invention will now be described based on a smartphone having the above-described configuration.

FIG. 2 is a flowchart schematically illustrating an execution process of a live capturing method in a smartphone according to an embodiment of the present invention.

2, a live capturing method in a smartphone according to the present invention includes a user input unit 140 capable of receiving a command of a user, a user input unit 140 or an external remote control A memory 130 for storing an operating system (OS) for operating a smartphone, various application programs and specific data or information, and a memory 130 for storing various data, And a display unit (150) for displaying a default screen and a processing result of the controller (180) on a screen.

In the live capturing method in the smartphone of the present invention, a capture command by a user's operation of a key (button) is displayed on the screen of the display unit 150 when at least one of an image or text is displayed on the screen of the display unit 150, The control unit 180 captures the current display screen and stores the current display screen in the memory 130 (steps S201 to S204).

Then, when an 'import' command is input to the imaged file including at least one of the image or text stored in the memory 130 by the capture, the control unit 180 calls the corresponding file, On the screen of the display unit 150 (step S205). In this case, in addition to the case of displaying on the screen of the display unit 150 as described above, there may be a case where an instruction for saving is stored in another directory of the memory 130 or an instruction for transmission to a certain destination is inputted. May be stored in another directory of the memory 130 or attached as an attached file for transmission to a corresponding destination.

The above describes the main points of the live capturing method in the smartphone according to the present invention. Hereinafter, the live capturing method in the smartphone of the present invention as described above will be described in more detail.

Referring again to FIG. 2, when an arbitrary command is input through the user input unit 140, the controller 180 determines whether the command is a capture command (that is, whether a capture command has been input) (step S201). In this determination, if it is a command other than the capture command, processing corresponding to the command is performed. If it is determined in step S201 that a capture command has been input, the control unit 180 determines whether to save the entire current display screen in the image mode after the capture operation, And stores the text portion in the text mode (Step S202).

In this regard, in the method of the present invention, the controller 180 stores the entire current display screen in the image mode, or stores the image portion of the current display screen in the image mode and the text portion in the text mode The user may select whether the current display screen is to be stored in the image mode, the image portion of the current display screen is stored in the image mode, and the text portion is stored in the text mode.

At this time, a menu window that can be selected by the user such as "save in full screen image mode" and "store image mode and text mode distinction" The user can select a desired storage form.

If it is determined in step S202 that the entire current display screen is to be stored in the image mode (this is a result that the user has selected "Save in full screen image mode ", the control unit 180) The entire display screen is stored in the image mode (step S203).

If it is determined in step S202 that the image portion of the current display screen is to be stored in the image mode and the text portion is to be stored in the text mode The controller 180 stores the image portion of the captured current display screen in the image mode, and stores the text portion in the text mode (Step S204).

Here, in the case where the image portion is stored in the image mode and the text portion is stored in the text mode, for converting the captured image portion into the text mode and storing the image portion, for example, ) Application (for example, an OCR program called "OCRTOOLS " developed by a Japanese company) into a text based on the technology of the present invention .

5), telephone numbers 311, 321, 333, and 511 (see FIG. 3B) among the text portions, and a text portion And 5) or the email address 411 (see FIG. 4) may be converted into a clickable form and stored. Here, the technique for converting the clickable form into a clickable form can be applied by using a simple design change, and the detailed description thereof will be omitted.

5), telephone numbers 311, 321, 333 and 511 (see FIGS. 3 and 5) or email address 411 (see FIG. 4) Preferably, when a web address, a telephone number, or an e-mail address is clicked, it can be converted into a linkable mode that can be directly connected to the corresponding web address, a telephone number, or an e-mail address. In this regard, in the memory 130, when an arbitrary image or a specific portion of the text that is not linkable is selected, a separate application for linking the selected portion can be stored. Here, such a conversion technique into a linkable mode is also a technology that has already been implemented and used in a computer or an internet environment, and can be similarly applied by a simple design change, and therefore, a detailed description thereof will be omitted here .

In addition, when the current display screen is captured by the controller 180 and stored in the memory 130, the entire display screen or a certain selection area in the display screen can be stored. To this end, the method of the present invention may further comprise the step of discriminating between "full display screen storage" or "

At this time, even in the case of a file in which a certain selection area in the display screen is stored, when the control unit 180 calls the corresponding file and displays it on the screen of the display unit 150 according to an input of a ' , And display the corresponding image or the entire text including the predetermined selection region.

In addition, when the current display screen is captured by the controller 180 and stored in the memory 130, when the captured object is a business card, the entire business card is directly stored as an image file, May be configured to be separately stored in the phone book of the smart phone of the user, the email address in the email address book, and the web address in the web address book, respectively.

Herein, in the above-described capturing and storing in the smartphone, preferably, the method of the present invention is characterized in that the user performs a key operation of the user with respect to a web address, a telephone number, or an e- The controller 180 captures a certain portion of a voice call content including a web address, a telephone number, or an e-mail address called by the other party by the control unit 180 And storing the data in the memory 130.

At this time, in capturing a certain portion of voice (voice) contents including a web address, a telephone number, or an e-mail address called by the other party and storing the captured portion in the memory 130, And may be configured to convert a voice signal into a character and store it. Here, the technique of converting a voice signal into a character (text) is a technology implemented in a smart phone or a PDA, and a detailed description thereof will be omitted.

When a 'load' command is input to the imaged file including at least one of the image or text stored in the memory 130 by the capturing after the series of capturing and storing operations as described above is completed, 180) displays the corresponding file on the screen of the display unit 150 (step S205).

5) and phone numbers 311, 321, 333, and 511 (refer to FIG. 3 and FIG. 3) in the image of the corresponding file. In this case, the controller 180 displays the corresponding file on the screen of the display unit 150, 5) or the email address 411 (see FIG. 4) is clicked (step S206), the control unit 180 directly links the website or the corresponding phone number or email address corresponding to the web address 512 (Step S207). Accordingly, the user simply connects to the desired web site, telephone number, or e-mail address. As a result, the user can obtain desired information or communicate with the other party without going through the troublesome process as in the conventional method. This means that the convenience of using smartphones will be further improved.

3 to 5 show files captured and stored according to a live capturing method in a smartphone according to the present invention. FIG. 3 is a view showing a capture screen with an image and a capture screen with an image and text together FIG. 4 is a view showing a capture screen with only text, and FIG. 5 is a view showing a capture screen including an image, a text, a web address of a specific site, a web screen configuration, and the like.

Referring to FIG. 3, there is shown a captured screen with an image and a captured screen together with an image and a text. In the case of (A) and (B) It is a screenshot with text.

In the screens A and B, reference numerals 310 and 320 denote the entirety of the captured image, and reference numerals 311 and 321 denote telephone numbers existing in the captured image, respectively.

In the capture screen C, 320 represents the entire captured screen, 331 represents an image portion in the captured image, 332 represents a text portion, and 333 represents a telephone number existing within the captured image. In the capture screen C, the text portion 332 may be stored in the image mode or in the text mode according to the user's selection, as described above.

Referring to FIG. 4, this is a text-only capture screen. Reference numeral 410 denotes an entire captured screen, and 411 denotes an e-mail address existing in a captured screen.

Referring to FIG. 5, it shows a captured screen including an image, a text, and a web address of a specific site, a web screen configuration, etc. Reference numeral 510 denotes an entire captured screen. Reference numeral 511 denotes a telephone number And 512 indicates a web address present in the captured screen.

As described above, the Web address 512, the telephone number 311, 321, 333, 511, or the e-mail address 411 in FIGS. 3 to 5 are converted into a clickable form and stored, When an address, telephone number or e-mail address is clicked, it is converted into a linkable mode that can be directly connected to the corresponding web address, telephone number or e-mail address and stored.

However, the live capturing method according to the method of the present invention is not limited to a smartphone, and may be applied to a general computer, a notebook computer, a PDA, It will be apparent to those skilled in the art that the present invention can be applied to all devices.

Hereinafter, a live capturing method in a smart phone according to the present invention will be described in brief with reference to a capturing function and storage.

The smart link function that LG Electronics recently introduced in Korea will be described first.

UX / UI, Smart Link functionality is included in View 3 and G2. This is a function that links and uses various information on words or phrases on the screen when using G2 or View3, as if the Internet browser is hypertext link (linking Internet web page address to text). Usually, when you use the Internet with a smartphone web browser or select a specific word or sentence in a text message or a katok, basic options such as setting a block, specifying an area such as a character, copying, pasting, and cutting are displayed , G2 and View 3 have an additional option called 'Smart Link'.

The options of this smart link that can be used in the LG Smartphone G2 and View 3 can be used in conjunction with the addition of a calendar event, a map connection, an Internet connection, and a memo option. In addition, the Capture All feature allows you to capture the entire screen of a currently viewed website, blog, or mobile page, and all screens that include scrolling. When capturing a smartphone screen, you can save the screen capture range by subtracting the sidebar or top header from the whole page, or subtracting the comment part. The left screen shot image of FIG. 6 shows a screen capture of the whole web page by using the capture all function, and then a screen shot is taken and designated to be stored. As shown in the image on the right side of FIG. 6, it is possible to capture and store only the main text except for the upper and lower sides of the blog and the sidebar. This Capture All function is designed to make it possible to take all or part of a web site that is being browsed by a browser using a computer, such as Explorer, Chrome, or Firefox, by using an add-on function or a toolbar. UX, and UI. Therefore, in the method of the present invention, such UX and UI can be applied for capturing.

As described above, a live capturing method in a smartphone according to the present invention is a method of capturing a web address, a telephone number, or an e-mail address together with an image or text while the user uses the smart phone, When a web address, telephone number or e-mail address in the image of the stored file is clicked, it is possible to directly provide the user with convenience of using the smart phone by directly connecting to the corresponding website, telephone number, or e-mail address .

In addition, when such a service is provided to a smart phone or an application that performs such a function is applied to a smart phone, the market competitiveness of the product (smart phone) can be further enhanced as compared with the non-smart phone, And the profit increase effect will be expected.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but many variations and modifications may be made without departing from the spirit and scope of the invention. Be clear to the technician. Accordingly, the true scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of the same should be construed as being included in the scope of the present invention.

100: mobile terminal 110: sensing unit
120: Capture unit 130: Memory
140: user user input unit 150: display unit
160: communication unit 170: recommendation unit
180: Control unit 200: External device
310,320: Full screen of captured image
311,321: Phone number present in the captured image
331: Image portion on captured screen
332: Text portion in captured screen
333,511: Phone number present in the captured screen
410,510: Full screen capture
411: E-mail address in the captured screen
512: Web address in the captured screen

Claims (10)

A control unit for processing data or signals according to a command input through a user input unit or an external remote control, an operating system (OS) for smart phone operation, various application programs, 1. A capturing method in a smartphone including a memory for storing specific data or information and a display unit for displaying a defaultized basic screen according to a smart phone operation and a result of processing by the control unit on a screen,
a) capturing a current display screen by the control unit when a capture instruction by a user's key operation is input through the user input unit while at least one of an image or text is displayed on the screen of the display unit, and storing the current display screen in the memory step; And
b) If an 'import' command is input to the imaged file containing at least one of the image or text stored in the memory by the capture, the control unit may retrieve the file and display it on the screen of the display unit, And attaching it as an attachment file for storage in a different directory or for transmission to the destination,
Wherein the current display screen is captured by the control unit and stored in the memory in step a), the current display screen is stored in the image mode, the image portion of the current display screen is stored in the image mode, Saved in text mode,
In the step b), the control unit retrieves the corresponding file and displays it on the screen of the display unit. If a web address, a telephone number, or an e-mail address in the image of the file is clicked, Wherein the live capturing method is performed on a smart phone.
The method according to claim 1,
Wherein a web address, a telephone number, or an e-mail address of the text portion is converted into a clickable form and stored in the text mode, when the image portion of the current display screen is stored in the image mode and the text portion is stored in the text mode. Live capturing method on the phone.
3. The method of claim 2,
A web address, a telephone number, or an e-mail address of the text portion is converted into a clickable form and stored. When a web address, a telephone number, or an e-mail address is clicked, a linkable and a linkable mode is stored in the linkable mode. The method according to claim 1,
Wherein a separate application for linking the selected portion is stored in the memory when a certain portion of a certain image or text is selected that is not linkable.
The method according to claim 1,
The control unit may store the entire current display screen in the image mode or store the current display screen in the image mode to store the image portion in the image mode and the text portion in the text mode, Further comprising the step of selecting whether to save the image portion of the current display screen in the image mode and save the text portion in the text mode.
The method according to claim 1,
Wherein the controller captures the current display screen by the controller in step a) and stores the entire display screen or a predetermined selection area on the display screen in the memory. The method according to claim 6,
In the case of a file in which a certain selection area in the display screen is stored, the control unit calls the corresponding file and displays it on the screen of the display unit according to the input of the 'load' command in step b) And displaying the corresponding image or the entire text including the area.
The method according to claim 1,
In the step a), when the current display screen is captured by the control unit and is stored in the memory, when the captured object is a business card, the entire business card is directly stored as an image file, And the web address is stored separately in the phone book of the smart phone, the email address in the email address book, and the web address in the web address book.
The method according to claim 1,
In capturing by the smartphone, if a capture command by the user's key operation is input to the web address, the telephone number, or the e-mail address that the user calls while the user is communicating with the other party through the user input unit, Capturing a certain portion of a voice call content including a web address, a telephone number, or an e-mail address called by the other party, and storing the captured portion in the memory. Ring method.
10. The method of claim 9,
(Voice) call content including a web address, a telephone number, or an e-mail address to be called by the other party, and storing the captured voice signal in the memory, the voice signal for the web address, And the live capturing method in the smartphone.

Images