EP2565825A2

EP2565825A2 - Schedule managing method and apparatus using optical character reader

Info

Publication number: EP2565825A2
Application number: EP12182074A
Authority: EP
Inventors: Mi Jung Park; Tae Yeon Kim; Yu Mi Ahn; Gu Hyun Yang
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2011-08-31
Filing date: 2012-08-28
Publication date: 2013-03-06
Also published as: CA2846487C; AU2012302455A1; RU2014107560A; CA2846487A1; US9412032B2; CN103150088B; JP6077800B2; CN103150088A; AU2012302455B2; KR101870773B1; KR20130024280A; BR112014005044A2; RU2621626C2; WO2013032241A1; US20130050533A1; EP2565825A3; JP2013054742A

Abstract

A schedule managing method capable of automatically generating schedule data using data extracted from an image, and an apparatus thereof are provided. The schedule managing method preferably includes: setting at least one recognition region within an image; extracting data from the set recognition region; categorising the extracted data according to a predetermined categorisation rule; and generating schedule data using the categorised data.

Description

Field of the Invention

The present invention relates to a schedule managing method and apparatus. More particularly, the present invention relates to a schedule managing method capable of automatically generating schedule data using data extracted from an image, and an apparatus thereof.

Description of the Related Art

Due to various breakthrough designs and applications that have stimulated consumer demand, the market for purchasing portable terminals has grown rapidly. In particular, unlike existing portable phones having only a limited number of functions, a smart phone may down-load and install various applications for taking a photograph or recording a moving image, playback of audio and video, online games, watching broadcast media, accessing social media network services from an online market, etc.
Meanwhile, more recent portable terminals typically include a touch screen and provide a method for managing a user's schedule through the touch screen. However, in a conventional method for managing a schedule a user has to manually input information including a scheduled date written in a ticket or on a poster, which is inconvenient.

Summary of the Invention

It is an aim of embodiments of the present invention to address one or more of the problems of the prior art, and to provide a schedule managing method for recognizing data from an image in order to automatically generate schedule data, and an apparatus thereof.
In accordance with a first aspect of the present invention there is provided a schedule managing method comprising: setting, by a controller, at least one recognition region within an image to be displayed by a display; extracting, by the controller, data from the set recognition region; categorising, by the controller, the extracted data according to a predetermined categorisation rule; and generating schedule data using the categorised data.
In accordance with a second aspect of the present invention there is provided a portable terminal comprising: a camera arranged to capture an image; a controller arranged to extract data from an image received from the camera, to categorise the extracted data according to a predetermined categorisation rule, and to generate schedule data using the categorised data; a memory that stores the created schedule data; and a display unit that displays the created schedule data.
Another aspect of the invention provides a computer program comprising instructions arranged, when executed, to implement a method and/or apparatus in accordance with any one of the above-described aspects. A further aspect provides machine-readable storage storing such a program.

Brief Description of the Drawings

The exemplary objects, features and advantages of the present invention will become more apparent from the following detailed description in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating a configuration of a schedule managing apparatus according to an exemplary embodiment of the present invention;
FIG. 2 is a view illustrating a preview screen and a photographing menu screen according to an exemplary embodiment of the present invention;
FIGS. 3, 4 and 5 are views illustrating a function for improving a data recognition rate according to an exemplary embodiment of the present invention;
FIG. 6 is a view illustrating a multiple focusing function according to an exemplary embodiment of the present invention;
FIG. 7 is a view illustrating a recognition region selection function according to an exemplary embodiment of the present invention;
FIGS. 8 and 9 are views illustrating a schedule creation function according to an exemplary embodiment of the present invention;
FIG. 10 is a flowchart illustrating a schedule managing method according to an exemplary embodiment of the present invention; and
FIG. 11 is a flowchart illustrating a schedule managing method according to another exemplary embodiment of the present invention.

Detailed Description

A schedule managing method and apparatus according to exemplary embodiments of the present invention are further described herein with reference to the accompanying drawings in detail. The same reference numbers are used throughout the drawings to refer to the same or similar parts. Detailed descriptions of well-known functions and structures incorporated herein are omitted to avoid obscuring appreciation of the subject matter of the present invention by a person of ordinary skill in the art.
It will be apparent to a person of ordinary skill in the art that a schedule managing apparatus according to the presently claimed invention is applicable to various information communication devices and multi-media devices such as a portable phone, a smart phone, a tablet PC, a handheld PC, a Portable Multimedia Player (PMP), a Personal Digital Assistant (PDA), a music player (e.g., MP3 player), a portable game terminal, or a digital broadcasting player.
A schedule managing apparatus according to the present invention preferably includes an optical character reader and a user input device. The optical character reader may include a camera and a character reading application for recognizing and extracting a character from an image. As known to those skilled in the art, the user input device may comprise at least one of a write pen, a mouse, a touch pad, a track ball, and a touch screen. Hereinafter, for explanatory purposes it is assumed that the schedule managing apparatus of the present invention comprises a smart phone and the user input device comprises a touch screen. The schedule managing apparatus of the present invention preferably includes an application or a widget arranged to manage a schedule of a user. In this case, the widget comprises a mini application such as an "app" that allows a user to directly use contents or functions. Example widgets include weather, calendar, calculator, and news widgets. Hereinafter, it is assumed in the present invention that where reference is made to a schedule managing application this includes a schedule managing mini application, app or widget. The schedule managing application may be downloaded from an online market.
In particular, a schedule managing application according to an embodiment of the present invention may provide a function for recognizing and extracting data from a photographed or stored image, and a function for automatically categorising the extracted data into one of a group of predetermined categories according to a predetermined categorisation rule. Further, the schedule managing application according to embodiments of the present invention may also provide a function for improving a recognition rate of data at the time of photographing or capturing an image. In more detail, the foregoing functions may include a function for compensating for hand trembling while photographing or recording videos, a function for displaying a visual cue, namely, an indicator indicating whether an image to be captured is horizontal based on a tilt input from a sensor, a function for focusing an image to a pointed position by the user in a preview state, namely, in a state while the camera is displaying a photographed image, and a function for setting a photographing mode of the camera according to a type of the image.
FIG. 1 is a block diagram illustrating a configuration of a schedule managing apparatus according to an exemplary embodiment of the present invention.
Referring now to FIG. 1, a schedule managing apparatus of the present invention may preferably include a touch screen 110, a key input unit 120, a display unit 130, a memory 140, a sensor 150, a camera 160, and a controller 170.
The schedule managing apparatus in accordance with FIG. 1 may display a preview screen and an overlapping photographing menu screen. In this case, the photographing menu screen includes a mode selection icon for selecting a photographing mode, a capture icon for capturing a photographed image, namely, a preview screen, and a gallery icon for selecting a stored image.
Further, in one exemplary embodiment of the present invention, the schedule managing apparatus may display an overlapped indicator indicating whether a degree of a tilt of the image is within a predetermined range chosen for optimal character recognition. In other words, the schedule managing apparatus displays the indicator that allows the user to ensure that the camera, and therefore the image to be captured, is aligned with the object to be captured such that characters within the image are aligned with an axis of a display screen, for instance an X axis. Alternatively, the indicator may indicator whether the degree of tilt of the image relative to a horizontal plane is within a predetermined range. Further, the schedule managing apparatus preferably focuses the captured image at a position pointed to by the user. In particular, the schedule managing apparatus according to the present invention preferably supports a multiple focus function. The schedule managing apparatus may display an indicator at the focal point. The schedule managing apparatus may classify modes, for example, classifying a photographing mode into a PC screen photographing mode, a ticket photographing mode, and a poster photographing mode. The schedule managing apparatus may automatically control the magnification of a camera according to the classified photographing mode.
Furthermore, the schedule managing apparatus may display an image capture screen and an overlapping schedule creation menu screen. In this case, the schedule creation menu screen includes a selection tool icon for selecting a recognition region, a release icon, and a termination icon. Further, the schedule managing apparatus extracts data from a selected recognition region, creates schedule data including some or all of the extracted data, and displays a schedule entry screen including a title, a due date, detailed information, and location information of the schedule. Hereinafter, respective structural elements of the schedule managing apparatus will be illustrated in detail.
With continued reference to FIG. 1, a touch screen 110 generates a touch event and transfers the generated touch event to a controller 170 in response to a user touch with respect to a certain point of an image display screen. The touch event may be classified into various categories such as, for example, touch, tap, double tap, press, drag, drag & drop, flick, and drag & flick according to its operation. In this exemplary case, the touch is, for example, an operation in which a user touches one point of the touch screen. The tap is, for example, an operation in which the touches one point of the touch screen and removes the touching object, for instance a finger, from a corresponding point without movement of the finger after touching one point. For a touch event to be classified as a tap may require that the touch is removed from the touch screen within a predetermined period of time. The double tap is, for example, an operation in which a user taps the touch a screen in one area twice within a predetermined period of time. The press is, for example, an operation in which a user removes a finger from a corresponding point of the touch screen without movement of the finger after touching the touch screen for longer than the predetermined period of time to register a tap. The drag is, for example, an operation in which a user moves a finger in a predetermined direction while the user maintains touching contact with the touch screen. The drag & drop is, for example, an operation in which a user removes a finger after dragging the finger. The flick is, for example, an operation in which a user removes a finger after moving the finger at rapid speed across the touch screen. Herein, a drag input may also be referred to as 'scroll'. The drag & flick is, for example, an operation in which a user drags a finger across the touch screen and then flicks the finger at a predetermined time point. That is, a drag & flick comprises a drag followed by a flick without interruption and without removing the finger from the screen. The controller 160 may, for example, distinguish the flick from the drag based on moving speed. The controller 160 controls the display unit 130 in response to the touch event.
The key input unit 120 comprises one or more keys for operating the schedule managing apparatus, and transferring key input signals to the controller 170. The controller 170, for example, controls the display unit 130 in response to the key input signal. The key input signal may comprise a power on/off signal, a volume control signal, or a screen on/off signal.
With continued reference to FIG. 1, the display unit 130 converts image data received from the controller 170 into an analog signal, and displays the analog signal. In other words, the display unit 130 displays various screens such as a lock screen, a home screen, and an application execution screen according to the use of the schedule managing apparatus. In one particular exemplary case, the lock screen is an image displayed when a power on signal for the display unit 130 is generated. If a trace of a drag touch screen input corresponds to a pre-set trace, the controller 170 changes an image displayed on the screen from a lock screen to a home screen or an application execution screen. The home screen is an image preferably including a plurality of icons for executing an application. If the user touches an icon, the controller 170 may execute a corresponding application and change a displayed image from the home screen to the application execution screen. In particular, an execution screen of a schedule managing application includes the foregoing preview screen, photographing menu screen, capture screen, schedule creation menu screen, and schedule screen.
The display unit 130 may comprise a flat panel display such as a Liquid Crystal Display (LCD) or an Organic Light Emitted Diode (OLED), or any other type of thin-film technology display screen. The display unit 130 may include, for example, a 3D implementing unit for displaying a left image and a right image, and allowing a user to feel depths of the left and right images. As can be appreciated by persons skilled in the art, a 3D implementing scheme is divided into a spectacle scheme and a non-spectacle scheme. The spectacle scheme preferably includes a colour filter scheme, a polarizing filter scheme, and a shutter glass scheme. The non-spectacle scheme includes a lenticular lens scheme and a parallax barrier scheme.
The memory 140, which preferably comprises a non-transitory machine readable medium, stores a screen to be outputted on the display unit 130. In particular, the memory may store an execution screen of a schedule managing application as well as an application necessary for a function operation according to an exemplary embodiment of the present invention. Further, the memory 140 may store a key map or a menu map for an operation of the touch screen 110. In this case, the key map and the menu map may comprise various forms. In other words, the key map may comprise, for example, a keyboard map, a 3*4 key map, a Qwerty key map, a Dvorak key map, or a control key map for controlling a currently executed application. Further, the menu map may comprise a menu map for controlling a currently executed application.
With continued reference to FIG. 1, the memory 140 may include a program area and a data area. The program area may store, for example, an operating system (OS) for booting the schedule managing apparatus and operating the foregoing constructions, and an application program for supporting various user functions, for example, a user-function for supporting a call function, a web browser for accessing an Internet server, an MP3 user function for playing other sound sources, an image output function for playing photographs, and a moving image playback function, etc.
In particular, the program area of the present invention may store, for example, the foregoing schedule managing application. The data area comprises an area for storing data created by the controller 160, in particular, to store a schedule according to the use of the schedule managing apparatus, and may, for example, store an image (e.g., map) associated with the schedule, due date information, alarm time, a pre-set value indicating presence of a set snooze function, and detailed information thereof.
The sensor 150 measures and transfers a tilt of the schedule managing apparatus to the controller 170. In detail, the sensor 150 measures and transfers a horizontal degree θ_w (referred to as 'width wise tilt' hereinafter) between a horizontal plane and a width wise direction of the schedule managing apparatus, and a horizontal degree θ_l (referred to as 'lengthwise tilt' hereinafter) and a lengthwise direction of the schedule managing apparatus to the controller 170. The sensor 150 may be implemented by, for example, an acceleration sensor or an inertial sensor.
The camera 160 photographs an image and outputs the captured image to the controller 170. The camera may comprise a camera module including two or more separate cameras, for instance a front camera disposed at a front surface of the terminal, and a rear camera disposed at a rear surface of the terminal.
In particular, the camera 160 may include, for example, a function for controlling amplification, a macro photographing function, a hand trembling correction function to correct for blurred still images and bouncy moving images, and a multiple focusing function. In this case, the camera 160 preferably includes at least two lenses to support the multiple focusing. Multiple focusing is made possible by a software scheme, as can be appreciated by a person of ordinary skill in the art.
The controller 170, which includes a processor or microprocessor, controls an overall operation and signal flow between internal blocks of the schedule managing apparatus. In particular, the controller 170 according to an exemplary embodiment of the present invention controls the display unit 130 to display an execution screen of the schedule managing application in response to an input touch event. Further, the controller 170 guides the suitability of image photographing based on a tilt input from the sensor 150 to the user to provide a type of feedback. Further, the controller 170 controls the camera 160 to perform multiple focusing in response to a touch event input from the touch screen. Further, the controller 170 also extracts data from the focused region, and creates schedule data using the extracted data according to one or more predetermined rules. Further, the controller 170 may extract data from the recognition region set or requested by the user. The functions of the controller 170 are described with reference to accompanying drawings in more detail.
FIG. 2 is a view illustrating a preview screen and a photographing menu screen can look according to one exemplary embodiment of the present invention. It will be appreciated that the appearance of the preview screen and the photographing menu screen may vary widely. Referring now to FIG. 2, if an icon for executing a schedule managing application of icons displayed on a home screen is touched, the touch screen 110 transfers a corresponding touch event to the controller 170 for execution of a corresponding action. Accordingly, the controller 170 controls the display unit 130 to display a main screen of the schedule managing application. For example, the schedule screen may be designated as the main screen. If a photographed icon is touched on the main screen, the touch screen 110 transfers a corresponding touch event to the controller 170. Accordingly, the controller 170 drives the camera 160. Further, as shown in FIG. 2, the controller 170 transfers a preview screen 210 input from the camera 160 to the display unit 130 such that the display unit 130 displays the preview screen 210. The controller 170 may control the display unit 130 to overlay the photographing menu screen 220 with the preview screen 210. In this case, the photographing menu screen 220 may include a mode selection icon 211, a capture icon 212, and a gallery icon 213. The user may select a photographing mode in a toggle scheme. In detail, the photographing mode may be classified into a PC screen photographing mode, a ticket photographing mode, and a poster photographing mode. If a PC photographing mode is selected as the photographing mode, the mode selection icon 211 may be display 'PC'. If the user taps or flicks a mode selection icon 211 displaying 'PC', the touch screen 110 transfers a corresponding touch event to the controller 170. Accordingly, the controller 170 controls the display unit 130 such that the mode selection icon 211 displays 'Ticket'. As shown in FIG. 2, a ticket captured by the camera 160 is displayed by the preview screen 210. Further, the controller 170 controls a camera 160 to change currently set amplification to amplification previously designated in a ticket photographing mode. As illustrated previously, the controller 170 performs a control operation to change a mode to a photographing mode of at least one of a PC, a ticket, and a poster according to selection of the mode selection icon 211. Meanwhile, if a capture icon 212 is selected, the controller 170 captures an image input from the camera 160, stores the captured image in the memory 140, and controls the display unit 130 to display a capture screen. Further, if the gallery icon 213 is selected, the controller 170 stops driving of the camera 160. More particularly, the controller 170 controls the display unit 130 to display a stored image instead of a preview screen 210.
FIGS. 3 to 5 are exemplary views illustrating a function for improving a data recognition rate according to an exemplary embodiment of the present invention. Referring now to FIG. 3, a controller 170 firstly recognizes data from an image input from the camera 160. Then, the controller 170 measures a width wise reference line 301 and a horizontal degree Φ (303, referred to as 'data tilt') of a width wise reference line 302 of the schedule managing apparatus. In this case, the controller 170 may control the display unit 130 to display a width wise reference line 301 of recognized data and a width wise reference line 302 of the schedule managing apparatus. The controller 170 compares the measured data tilt Φ 303 with a predetermined data tilt threshold value Th_Φ. In a comparison result, if the measured data tilt Φ is less than the predetermined data tilt threshold value Th_Φ, the controller 170 may make the width wise reference lines 301 and 302 disappear.
Referring now to FIG. 4, if the schedule managing application is in a photographing mode, the controller 170 drives the sensor 150. Accordingly, the sensor 150 measures and transfers a width wise tilt θ _w 431 between a horizontal plane 420 in which the image 410 is located and a width wise direction of the schedule managing apparatus 430 to the controller 170. Further, the sensor 150 measures and transfers a lengthwise tilt θ_l between the horizontal plane 420 and a lengthwise direction of the schedule managing apparatus 430 to the controller 170. Accordingly, the controller 170 compares the received width wise tilt with a predetermined width wise tilt threshold Th_θ_w. Further, the controller 170 compares the received lengthwise tilt with a predetermined lengthwise tilt threshold Th_θ_l.
Referring now to FIG. 5(a), if conditions of Φ ≤ Th_Φ, θ_w ≤ Th_θ_w, and θ_l ≤ Th_θ_l are satisfied in the comparison result, the controller 170 controls the display unit 130 to display a first indicator 515 indicating that recognition of an image satisfies the predetermined conditions.
Conversely, if any one of the foregoing conditions is not satisfied, as shown in FIG. 5(b), the controller 130 controls the display unit 130 to display a second indicator 525 that recognition of the image does not satisfy the predetermined conditions". It is easier (i.e. less computing intensive) to recognize an image that satisfies the above predetermined conditions versus one that does not satisfy the above predetermined conditions. The condition is one example for concretely describing an operation of the present invention and may be varied as desired. In this case, the difference between first indicator 515 and second indicator 525 is that first indicator 515 is fully shaded. However, the person of ordinary skill in the art should understand and appreciate numerous other options can be performed that are within the scope of the claimed invention. For example, the indicators may blink or blink at different rates, can be different sizes, different colours or displayed for different durations.
FIG. 6 is a view illustrating a multiple focusing function according to an exemplary embodiment of the present invention.
Referring now to FIG. 6, the controller 170 controls the display unit 130 to display a preview screen 610. Furthermore, the controller 170 controls a display unit 130 to overlap a mode selection icon 621, a capture icon 622, and a gallery icon 623 with the preview screen 610. If a plurality of certain points 631, 632, and 633 are touched on the preview screen 610, the touch screen 110 transfers a corresponding touch event to the controller 170. Accordingly, the controller 170 controls the display unit 130 to display respective focuses 641, 642, and 643 in certain touched points 631, 632, 633. The controller 170 controls the camera 169 to perform multiple-focusing the certain touched points 631, 632, 633.
FIG. 7 is a view illustrating a recognition region selection function according to an exemplary embodiment of the present invention. Referring back to FIGS. 2 and 6, if a capture icon 212 or 622 is selected, a controller 170 captures an image input from a camera 160.
Referring now to FIG. 7(a), the controller 170 controls the display unit 130 to display a capture screen 710 with a captured image. The controller 170 may control the display unit to overlap a schedule data creation menu screen 720 with a capture screen 710. It should be understood that alternatively screens 710 and 720 may occupy different areas shown by the display such that they are not overlapped. A selection tool icon 721 for selecting a recognition region, a release icon (Cancel), and a completion icon (OK), may be included in the schedule creation menu screen 720. Further, the selection tool icon 721 may be configured to include a pre-set figure 721a and a user designation figure 721b.
If the pre-set figure 721a shown in FIG. 7 is selected, the controller 170 sets a recognition region 740 including data located in a touched point 730 based on the touched point 730. Further, the controller 170 controls the display unit 130 to display the set recognition region 740. If the touched point 730 is retouched or a displayed recognition region 740 is touched, the controller 170 releases the set recognition region 740. The controller 170 controls the display unit 130 to make the recognition region 740 disappear. The controller 170 may set a plurality of recognition regions in the foregoing manner.
Meanwhile, if the user designation figure 721b is selected, as shown in FIG. 7(c), the controller 170 controls the display unit 130 to display a trace 750 drawn by the user. As shown in FIG. 7(d), when the trace 750 becomes a closed curve 760, the controller 170 sets a region in the closed curve as a recognition region. The set recognition region may be released by user touching.
FIGS. 8 and 9 are views illustrating a schedule creation function according to an exemplary embodiment of the present invention.
Referring to FIG. 8(a), if a completion icon 813 is selected, the controller 170 extracts data from set recognition regions 825 and 835. If a release icon 840 is selected, the screen returns to a preview screen or a main screen.
Next, referring to FIG. 8(b), a controller 170 categorises extracted data into a group of predetermined categories according to a predetermined categorisation rule. In this particular exemplary case, the extracted data may include various information such as images and maps as well as texts. The controller 170 controls the display unit 130 to display a schedule data entry screen 850 including created schedule data. The controller 170 may categorise the portion of the extracted data having the largest font as a title. The controller 170 categorises information associated with a time in the extracted data as a scheduled date. In this particular case, referring to FIG. 8(b), the scheduled date may include a start time and an end time. The end time may become a value that the controller 170 automatically designates with reference to the start time. In other words, the controller 170 categorises the extracted time as a start time, and sets one hour after the start time as the end time. When there are a plurality of extracted times, the controller 170 may categorise the earliest time of the extracted times as the start time, and categorise remaining times as detailed information. Further, the controller 170 categorises remaining data except for data as a title and a scheduled date as detailed information. If a storage icon 860 is selected, the controller 170 stores the created schedule in the memory 140. Conversely, if a release icon 870 is selected, the screen is returned to the preview screen or a main screen.
Referring now to FIG. 9, if the detailed item 915 is selected, a controller 170 controls the display unit 130 to display an item change menu 925. Further, the controller 170 changes an existing item to an item selected from the item change menu 925, for example, "Location". If a completion icon 930 is selected after an item has been changed (for instance to "Location"), the controller 170 may control the display unit 130 to display a schedule screen 960 including location information 950 associated with extracted data within the location item 940. In this case, the location information 950 may be downloaded from a server by the schedule managing apparatus through a network or be extracted from a map stored in the memory 140. If the image view icon 970 is selected, the controller 170 may control the display unit 130 to display a captured image.
FIG. 10 is a flowchart illustrating exemplary operation of a schedule managing method according to an exemplary embodiment of the present invention.
Referring now to FIG. 10, a controller 170 performs a schedule managing application at step 1001. At step 1002, when a photographing menu is selected from a displayed execution screen, then at step 1003 the controller 170 drives the camera 160. The controller 170 transfers an image input from the camera 160 to the display unit 130 such that the display unit 130 displays the image.
At step 1004, the controller 170 measures a data tilt from an input image. Then, the controller 170 compares the measured data tilt Φ and received camera tilts θ_w and θ_l from the sensor 150 to determine whether the camera is horizontal and whether the object to be photographed is aligned with the camera. In other words, the controller 170 determines whether conditions of Φ ≤ Th_Φ, θ_w ≤ Th_θ_w, and θ_l ≤ Th_θ_l are satisfied.
If the camera is not horizontal and the object is not aligned with the camera (when any one of the conditions is not satisfied), the controller 170 controls the display unit 130 to display a second indicator 525 at step 1005 indicating that image recognition will require significant processing. Conversely, when the image is horizontal within an error range and the object is aligned with the camera, the controller 170 controls the display unit 130 to display the first indicator 515 at step 1006 indicating that the conditions are satisfied and the recognition of the image requires less processing.
Next, if a capture icon 212 or 612 is selected, the controller 170 captures an image input from the camera 160 and stores the captured image in the memory 140 at step 1007. The controller 130 controls the display unit 130 to display a captured screen including the captured image at step 1008. Subsequently, the controller 170 sets at least one recognition region from a displayed image at step 1009 as described above with reference to FIG. 7. The controller 170 extracts data from the set recognition region at step 1010. The controller 170 creates schedule data including the extracted data according to a predetermined categorisation rule at step 1011, for instance as described above with reference to FIG. 8. The controller 170 stores the created schedule data at step 1012.
FIG. 11 is a flowchart illustrating a schedule managing method according to another exemplary embodiment of the present invention. Referring now to FIG. 11, steps 1101 to 1106 are identical to steps 1001 to 1006, and so a detailed description thereof is omitted. If at least one pointing event is sensed at step 1107, the controller 170 controls the camera 160 to focus at a point corresponding to a pointing event at step 1108. In other words, the controller 170 sets a recognition region from a preview screen using a focusing function of the camera 160. In this case, the pointing event is a user input event, such as a touch event occurring on the touch screen 110. Further, the controller 170 controls the display unit 130 to display a focus icon at the pointing point. If the capture icon 212 or 622 is selected, the controller 170 captures an image input from the camera 160 and stores the captured image in the memory 140 at step 1109. The controller 170 then extracts data from the captured image at step 1110. The controller 170 categorises the extracted data to create schedule data according to a predetermined categorisation rule at step 1111 as discussed above with reference to FIG. 8. The controller 170 stores the created schedule data at step 1112.
Advantageously, a schedule managing method and apparatus according to embodiments of the present invention allow data to be recognised from an image received from a camera or a stored image to automatically generate schedule data.
The above-described methods according to the present invention can be implemented in hardware, firmware or as software or computer code that can be stored in a recording medium such as a CD ROM, an RAM, a floppy disk, a hard disk, or a magneto-optical disk or computer code downloaded over a network originally stored on a remote recording medium or a non-transitory machine readable medium and to be stored on a local recording medium, so that the methods described herein can be rendered in such software that is stored on the recording medium using a general purpose computer, or a special processor or in programmable or dedicated hardware, such as an ASIC or FPGA. As would be understood in the art, the computer, the processor, microprocessor controller or the programmable hardware include memory components, e.g., RAM, ROM, Flash, thumbnail, etc. that may store or receive software or computer code that when accessed and executed by the computer, processor or hardware implement the processing methods described herein. In addition, it would be recognized that when a general purpose computer accesses code for implementing the processing shown herein, the execution of the code transforms the general purpose computer into a special purpose computer for executing the processing shown herein.
Accordingly, embodiments provide a program comprising code for implementing apparatus or a method as claimed in any one of the claims of this specification and a machine-readable storage storing such a program. Still further, such programs may be conveyed electronically via any medium such as a communication signal carried over a wired or wireless connection and embodiments suitably encompass the same.
Throughout the description and claims of this specification, the words "comprise" and "contain" and variations of the words, for example "comprising" and "comprises", means "including but not limited to", and is not intended to (and does not) exclude other moieties, additives, components, integers or steps.
Throughout the description and claims of this specification, the singular encompasses the plural unless the context otherwise requires. In particular, where the indefinite article is used, the specification is to be understood as contemplating plurality as well as singularity, unless the context requires otherwise.
Features, integers, characteristics, compounds, chemical moieties or groups described in conjunction with a particular aspect, embodiment or example of the invention are to be understood to be applicable to any other aspect, embodiment or example described herein unless incompatible therewith.
It will be also be appreciated that, throughout the description and claims of this specification, language in the general form of "X for Y" (where Y is some action, activity or step and X is some means for carrying out that action, activity or step) encompasses means X adapted or arranged specifically, but not exclusively, to do Y.
Although a schedule managing method and apparatus according to exemplary embodiments of the present invention have been described in detail hereinabove, it should be clearly understood that many variations and modifications of the basic inventive concepts herein taught which may appear to those skilled in the present art will still fall within the scope of the present invention as defined by the appended claims.

Claims

A schedule managing method comprising:
setting, by a controller, at least one recognition region within an image to be displayed by a display;

extracting, by the controller, data from the set recognition region;

categorising, by the controller, the extracted data according to a predetermined categorisation rule; and

generating schedule data using the categorised data.
The method of claim 1, further comprising:
measuring a tilt value of image data from an image received from a camera relative to an axis of the camera;

comparing the measured tilt value of image data with a first threshold to determine whether an object within the received image is aligned with the axis of the camera within a predetermined error range; and

displaying an indicator if it is determined that the object within the received image is aligned with the axis of the camera within the predetermined error range.
The method of claim 1 or claim 2, further comprising:
receiving a tilt input signal from a sensor; and

comparing the received tilt input signal from the sensor with a second threshold to determine whether the received image is horizontal within the predetermined error range; and

displaying an indicator if it is determined that the received image is horizontal within the predetermined error range.
The method of any one of the preceding claims, wherein setting at least one recognition region comprises:
receiving at least one user input event from a user input device while displaying a captured image; and

setting a point corresponding to the received user input event as a recognition region.
The method of any one of the preceding claims, wherein categorising the extracted data comprises categorising information associated with a time from the extracted data as a scheduled date.
The method of claim 5, wherein categorising by the controller the extracted data comprises:
categorising extracted data having the largest font in the extracted data as a title; and

categorising remaining extracted data as detailed information except for data classified as the scheduled date and the title.
The method of claim 6, wherein generating schedule data comprises changing detailed information to location information.
The method of any one of the preceding claims, further comprising:
receiving at least one user input event from a user input device; and

controlling a camera to focus at a point corresponding to the received user input event within a camera image;

wherein setting at least one recognition region comprises setting a recognition region at the point corresponding to the received user input event.
A portable terminal comprising:
a camera arranged to capture an image;

a controller arranged to extract data from an image received from the camera, to categorise the extracted data according to a predetermined categorisation rule, and to generate schedule data using the categorised data;

a memory that stores the created schedule data; and

a display unit that displays the created schedule data.
The portable terminal of claim 9, wherein the controller is arranged to measures a tilt value of image data from an image received from the camera relative to an axis of the camera, to compare the measured tilt of image data with a first threshold to determine whether an object within the received image is aligned with the axis of the camera within a predetermined error range, and to control the display unit to display an indicator if it is determined that the object within the received image is aligned with the axis of the camera within the predetermined error range.
The portable terminal of claim 9 or claim 10, further comprising a sensor arranged to measure and a tilt angle of the portable terminal relative to a horizontal plane and to transfer the measured tilt angle of the portable terminal to the controller, wherein the controller is arranged to compare the received tilt angle from the sensor with a second threshold to determine whether the portable terminal is horizontal within a predetermined error range.
The portable terminal of any one of claims 9 to 11, further comprising a touch screen arranged to generate a touch event in response to a touch input and to transfer the touch event to the controller, wherein the controller is arranged to set a recognition region in an image based on at least one touch event received from the touch screen, and to extract data from the set recognition region.
The portable terminal of any one of claims 9 to 12, wherein the controller is arranged to categorise information associated with a time from the extracted data as a scheduled date.
The portable terminal of claim 13, wherein the controller is arranged to categorise data having the largest font in the extracted data as a title, and to categorise remaining extracted data as detailed information except for data classified as the scheduled date and the title.
The portable terminal of any one of claims 9 to 14, further comprising a touch screen arranged to generate a touch event in response to a touch input and to transfer the touch event to the controller, wherein the controller is arranged to control the camera to focus at a point corresponding to the touch event received from the touch screen, to set a recognition region in an image based on the point corresponding to the touch event, and to extract data from the set recognition region.