JP5499994B2 - CALENDAR DEVICE AND COMPUTER PROGRAM HAVING ELECTRONIC EXPANSION FOR MEMORY SPACE OF PAPER CALENDAR - Google Patents

Description

  The present invention relates to a technology for electronically extending a memo space of a paper-based calendar that is used as a room interior, accompanied by a picture or photo that matches a monthly image.

  Paintings and photographs that match the image of each month are attached, and not only the confirmation of the month and day, but also a paper calendar used as the interior of the room (paper calendar), schedules and anniversaries can be written. There is a memo space that can be used, but if you use the memo space of a paper calendar with multiple people, such as a family, you will not be able to write the appointments of everyone in the memo space of the paper calendar. Could n’t share the schedule.

  The most common method for expanding the memo space of a paper calendar is to use an electronic calendar that runs on a computer instead of a paper calendar. Despite the memory limitations of computer devices that operate electronic calendars, much more information can be entered into the memo space of electronic calendars than the memo space of paper calendars.

  However, paper calendars can be used not only for checking the date, but also for room interiors, but electronic calendars cannot be used as room interiors. It is desirable to be able to expand.

  As an invention for associating a paper calendar with an electronic calendar, for example, Patent Document 1 discloses an invention for inputting the contents of a paper calendar (for example, an advertising flyer) on which a sale date is printed into a computer. .

  However, the invention disclosed in Patent Document 1 is an invention for inputting the contents printed on the paper calendar to a computer, and is not an invention for electronically expanding the memo space of the paper calendar.

JP 2007-128160 A

  Therefore, the present invention provides a calendar device and a computer program that can electronically expand a memo space of a paper-based calendar that can be used as a room interior, with pictures and photographs that match the monthly image. The purpose is to provide.

  According to the first aspect of the first invention for solving the above-mentioned problem, the moon is used as a photographing means for photographing a paper calendar by a camera and a means for electronically expanding a memo space of the paper calendar photographed by the photographing means. By recognizing the character string to be detected, the month recognition unit for recognizing the month of the paper calendar photographed by the photographing unit and the month recognition unit recognizes the month from the database storing the schedule data. The schedule data acquisition unit for acquiring the corresponding schedule data, and the schedule data included in the display period specified by the user in accordance with the display format specified by the user, the image of the paper calendar captured by the imaging unit A calendar device having a calendar means having a schedule display unit for pasting and displaying on a calendar device.

  Further, according to a second aspect of the first invention, in the first aspect of the first invention, a date frame having a memo space is formed on the paper calendar by vertical lines and horizontal lines arranged in a grid pattern, and the photographing means The date frame in which the finger included in the image being photographed is recognized by the finger and the straight line is blocked at the tip of the finger area obtained by finger recognition and the type of straight line blocked by the tip of the finger area The calendar means includes a finger recognition unit that determines a display format of the schedule data specified by the user from the type of the line, and determines a display period specified by the user from the date frame where the line is blocked. According to the second aspect of the first aspect of the present invention, the schedule data display format and display period can be designated by pointing the finger on the paper calendar.

  Further, according to aspect 3 of the first invention, in the aspect 1 or aspect 2 of the first invention, the schedule data is stored in a database on a network, and the schedule data acquisition unit of the calendar means stores the schedule from the database. In a calendar device that acquires data, when a plurality of users share and use one paper calendar, it is desirable to perform as in the aspect 3 of the first invention.

  Further, according to a fourth aspect of the first invention, in any one of the first to third aspects of the first invention, the month recognizing unit of the calendar means is moved from a clock circuit built in the calendar device to a month. The current month, the next month, and the next month at the time of recognizing the character are used as candidate months. The calendar device is a means for recognizing the month of the paper calendar being photographed.

  Further, according to a fifth aspect of the first invention, in any one of the second to fourth aspects of the first invention, the schedule display part of the calendar means is obstructed by a straight line at the tip of the finger region. The date frame is cut out in a row or column direction so as to conform to the display format of the schedule data determined by the finger recognition unit with the date frame as a reference, and the schedule data determined by the finger recognition unit A calendar apparatus for displaying the schedule data corresponding to a display period by pasting it on the cut-out video, and according to the aspect 5 of the first invention, the date frame corresponding to the display period of the schedule data. The video can be displayed.

  Further, the aspect 6 of the first aspect of the present invention is the aspect 5 of the first aspect of the present invention, wherein the finger recognition unit of the calendar means is configured such that when the type of straight line blocked by the tip of the finger region is a horizontal line, The display format of the schedule data is set to a week display, and a week including a date obtained from the date frame in which a straight line is blocked is determined as a display period. This is a calendar device that cuts out images of date frames.

  Further, according to aspect 7 of the first invention, in the aspect 5 or aspect 6 of the first invention, the finger recognition unit of the calendar means has a vertical line that is obstructed by the tip of the finger region. In this case, the display format of the schedule data is set to the day of the week display, the date of the day of the week obtained from the date frame where the straight line is blocked is determined as the display period, and the schedule display unit is arranged in the column direction based on the date frame. This is a calendar device that cuts out the video of the date frame.

  Further, according to an eighth aspect of the first invention, in any one of the fifth to seventh aspects of the first invention, the finger recognition portion of the calendar means is a straight line blocked by a tip portion of the finger region. If the type of the data is both vertical and horizontal lines, the display format of the schedule data is set to the date display, the date obtained from the date frame where the straight line is blocked is determined as the display period, and the schedule display section It is a calendar device that cuts out the image of the date frame in the row direction based on the date frame.

  A second invention for solving the above-described problem is a computer program that operates on a computer, and is a computer program for causing a computer to function as the above-described calendar means.

  As described above, according to the present invention described above, it is possible to electronically expand the memo space of the paper-based calendar that is used as the interior of the room, accompanied by paintings and photographs that match the monthly images. A calendar device and a computer program can be provided.

The figure explaining the system by which the calendar apparatus is arrange | positioned. An example of a screen of a calendar device. The block diagram of a calendar apparatus. The figure explaining the function of a calendar apparatus. The flowchart explaining operation | movement of a calendar application. An example of a screen when performing an operation to display schedule data. The flowchart of the process which recognizes the month of a paper calendar. The flowchart of the process which determines the display format and display period of schedule data. The figure explaining an example of the rule which determines the display format of schedule data. An example of the screen of the calendar device when the display format is a date format. An example of the screen of the calendar device when the display format is a week format. An example of the screen of the calendar device when the display format is a day of the week format.

  From this, the embodiments of the present invention will be described to the extent that those skilled in the art of the present invention can understand the contents of the present invention and implement the present invention.

  FIG. 1 is a diagram illustrating a system in which a calendar device 1 according to this embodiment is arranged. The system illustrated in FIG. 1 includes a paper calendar 3 provided with a memo space (hereinafter referred to as a paper calendar 3) and a calendar application that is an application for electronically extending the memo space of the paper calendar 3. 12 includes a calendar device 1 on which a calendar 12 operates, and a calendar server 2 in which a database storing user's schedule data using a paper calendar 3 is stored. The calendar device 1 accesses the calendar server 2 via a network 4. To do.

  The paper calendar 3 illustrated in FIG. 1 is a month-turned paper calendar 3, and each month's page is formed in a grid pattern with vertical and horizontal lines in addition to letters indicating the month (here, “October”). The date of the month 30 and the day of the week are printed in a grid pattern, and the blank space of the date frame 30 can be used as a memo space for entering a schedule or anniversary by handwriting.

  In this embodiment, the calendar server 2 shown in FIG. 1 is a device used as an auxiliary storage device for the memo space of the paper calendar 3, and the schedule data stored in the calendar server 2 is the calendar device 1 or the calendar device 1. Is input to the calendar server 2 using a device other than the above.

  In the present embodiment, the calendar server 2 used as an auxiliary storage device for the memo space of the paper calendar 3 is provided for each user who shares and uses the memo space of the paper calendar 3. Therefore, if multiple users have different calendar devices 1, if the schedule data is stored in one calendar device 1, multiple users can share the schedule data. Therefore, a calendar server 2 accessible from a plurality of calendar devices 1 is provided, and schedule data is stored in the calendar server 2.

  When a single calendar device 1 is shared by a plurality of users who share and use the memo space of the paper calendar 3, or when only one user uses the memo space of the paper calendar 3, the memory of the calendar device 1 is used. May be used as an auxiliary storage device for the memo space of the paper calendar 3, and the schedule data may be stored in the memory.

  The calendar application 12, which is an application for electronically expanding the memo space of the paper calendar 3, is taken by the camera 1f by analyzing the video of the paper calendar 3 taken by the camera 1f of the calendar device 1. The month is recognized from characters indicating the month of the paper calendar 3, and the schedule data of the recognized month and the date frame 30 included in the video of the paper calendar 3 are matched with the display format and display period of the schedule data designated by the user. By synthesizing the images and displaying them on the calendar device 1, the memo space of the paper calendar 3 is electronically expanded.

  FIG. 2 is an example of the screen of the calendar device 1. The screen 5a illustrated in FIG. 2 is a screen in which schedule data related to the week designated by the user's finger is displayed weekly, and the upper part of the screen 5a is an image of the paper calendar 3 corresponding to the week designated by the user's finger 6. In the lower part of the screen 5a, a daily schedule column is displayed. In this schedule column, for each date displayed in the upper part of the screen 5a, the scheduled data of the date is determined by the start time and the end time. It is displayed according to the scheduled period of.

  In this way, the actual paper calendar 3 is photographed by the camera 1f, and the schedule data obtained from the calendar server 2 is displayed on the image of the paper calendar 3 photographed by the camera 1f. Electronic information (here, schedule data) is added to the displayed memo space of the paper calendar 3, and the memo space of the paper calendar 3 is electronically expanded.

  From here, the calendar apparatus 1 illustrated in FIG. 1 and the calendar application 12 operating on the calendar apparatus 1 will be described in detail. FIG. 3 is a block diagram of the calendar device 1. In addition to the device used as the calendar device 1, the actual calendar device 1 includes elements other than those shown in FIG. 3, but FIG. 3 is necessary for explaining the present invention. Only the elements are shown.

  As shown in FIG. 3, the calendar device 1 includes a processor circuit 1a on which a CPU such as an application processor, RAM, and ROM are mounted, a camera 1f, a touch panel 1d, a clock circuit 1c, a memory 1e, a communication circuit 1b, and the like. Examples of the computer device that can be used as the calendar device 1 by a connected computer device include a mobile phone with camera, a smartphone with camera, and a notebook personal computer to which a Web camera is connected.

  An operating system for operating the CPU of the processor circuit 1a is mounted on the processor circuit 1a mounted on the calendar device 1 shown in FIG. 1, and the calendar application 12 is one application that operates on this operating system. Thus, the main body of the calendar application 12 is stored in the memory 1e of the calendar device 1.

  FIG. 4 is a diagram for explaining the function of the calendar device 1. As shown in FIG. 4, the calendar device 1 includes a photographing means 10 for photographing the paper calendar 3 with the camera 1f, and a character string representing the month. By recognizing characters, the month recognition unit 110 for recognizing the month of the paper calendar 3 photographed by the photographing unit 10 and the schedule data corresponding to the month recognized by the month recognition unit 110 are acquired from the calendar server 2. The data acquisition unit 111 and the date frame 30 in which the finger 6 included in the image photographed by the photographing unit 10 is recognized by the finger and the straight line is blocked by the tip of the finger region obtained by finger recognition and the tip of the finger region The type of the straight line blocked by the line is specified, the display format of the scheduled data specified by the user is determined from the type of the straight line, and the display period specified by the user is determined from the date frame 30 where the straight line is blocked. Recognition 112 And a schedule display unit 113 for pasting the schedule data included in the display period designated by the user in accordance with the display format designated by the user and pasting the data on the video of the paper calendar 3 photographed by the photographing means 10. A calendar means 11 is provided.

  The photographing unit 10 of the calendar device 1 is realized by using a camera 1f connected to the calendar device 1, and is a function that the calendar device 1 originally has. The calendar unit 11 of the calendar device 1 is mounted on the calendar device 1. This function is added to the computer device used as the calendar device 1 by the calendar application 12.

  FIG. 5 is a flowchart for explaining the operation of the calendar application 12. When the calendar application 12 is selected, the calendar application 12 is activated. When the calendar application 12 is activated, the photographing unit 10 is actuated to start photographing, and the photographing unit 10 displays the image photographed on the touch panel 1d. (S1) is performed.

  An operation for starting shooting of an image by operating the shooting unit 10 and displaying the video shot by the shooting unit 10 on the touch panel 1d, and then allowing the user to focus on the date frame 30 of the paper calendar 3 and display the schedule data. Is executed, the calendar application 12 executes a module functioning as the month recognizing unit 110, and analyzes the image of the paper calendar 3 photographed by the photographing means 10, so that the month of the paper calendar 3 being photographed is displayed. A recognition process is executed (S2).

  FIG. 6 is an example of a screen when an operation for displaying the schedule data is performed. The screen 5b shown in FIG. 6 displays a button 5b1 that is pressed by the user when displaying the schedule data in addition to the video shot by the shooting means 10, and the user presses the button 5b1 to An operation to display data is executed.

  FIG. 7 is a flowchart of processing for recognizing the month of the paper calendar 3 being photographed. The month of the paper calendar 3 being photographed is included in the image photographed by the photographing means 10 and means the moon. A character ("October" in FIG. 6) can be recognized by character recognition.

  In this embodiment, the calendar application 12 first obtains the current date from the clock circuit 1c of the calendar device 1 (S10), and the current month, the next month, and the next month at this time are stored in the paper calendar 3. A candidate month is determined (S11). For example, if the date acquired from the clock circuit 1c of the calendar device 1 is October 8, 2010, the calendar application 12 determines October, November, and December as candidate months for the paper calendar 3.

  When the calendar application 12 determines a candidate month for the paper calendar 3, it recognizes a character string such as a word or number meaning the month from the video imaged by the imaging means 10 (S12), and obtains it by character recognition. A candidate month in which a part or all of the character string indicating the candidate character string and the candidate month matches is specified as the month of the paper calendar 3 being photographed (S13).

  When characters such as words or numbers meaning the month are recognized from characters captured by the image capturing means 10, the image captured by the image capturing means 10 is binarized, and an appropriate area is designated and moved. After removing noise by applying an average filter, the video with the moving average filter is binarized again, clustered into character and non-character areas, and for character areas that are larger than other character areas, templates, etc. Character recognition using.

  In addition, when the character string obtained by character recognition is compared with the character string meaning the candidate month of the paper calendar 3, if the character obtained by character recognition is a number, the top two obtained by character recognition. If the character obtained by comparing the character with the number of the candidate month of the paper calendar 3 is an English word, the upper three characters obtained by character recognition and the English word that means the candidate month of the paper calendar 3 Compare the top three characters.

  From here, it returns to description of FIG. When recognizing the month of the paper calendar 3 being photographed, the calendar application 12 executes a module functioning as the schedule data acquisition unit 111 and acquires schedule data including the scheduled period in the recognized month from the calendar server 2. Then, schedule data corresponding to the month of the paper calendar 3 being photographed is acquired (S3).

  When the calendar application 12 acquires the schedule data of the month of the paper calendar 3 being photographed from the calendar server 2, the calendar application 12 determines the display format and display period of the schedule data designated by the user (S4).

  The calendar application 12 may be provided with a dialog or the like for acquiring the display format of the schedule data from the user. However, in this embodiment, the user's finger included in the video captured by the imaging unit 10 functions as a pointer. As a result, the calendar application 12 executes a module that functions as the finger recognition unit 112, recognizes the finger included in the video imaged by the photographing unit 10, and straightens at the tip of the finger region obtained by finger recognition. The date frame 30 where the line is blocked and the type of the line blocked by the tip of the finger area are specified, the display format of the scheduled data specified by the user is determined from the line type, and the date when the line is blocked A display period designated by the user is determined from the frame 30.

  FIG. 8 is a flowchart of processing for determining the display format and display period of the scheduled data. When analyzing the video shot by the shooting means 10 and determining the display format and display period of the scheduled data designated by the user, the calendar application 12 first extracts a straight line included in the video shot by the shooting means 10. (S20).

  When a straight line is extracted from the video imaged by the imaging means 10, the calendar application 12 recognizes the finger included in the video imaged using the skin color area and specifies the finger area in the video image (S21). ). Various finger recognition methods are available. For example, binarize the skin color area of the image captured by the image capturing means 10, specify an appropriate area, apply a moving average filter, remove noise, and remove noise After the video is binarized again, the black area corresponding to the skin color area is contoured and the finger area is specified by matching with the finger template.

  When the calendar application 12 identifies the finger area, the calendar application 12 identifies a straight line that intersects the tip of the finger area from the extracted straight lines (S22), and determines the display format of the scheduled data according to the type of the identified straight line (S23). .

  FIG. 9 is a diagram for explaining an example of a rule for determining the display format of the schedule data. FIG. 9A shows a case where the straight line intersecting the tip of the finger area is a vertical line, and when the straight line intersecting the tip of the finger area is a vertical line, the calendar application 12 determines the display format of the schedule data as weekly display. To do. FIG. 9B shows a case where the straight line intersecting the tip of the finger area is both a vertical line and a horizontal line, and when the straight line intersecting the tip of the finger area is a vertical line / horizontal line, the calendar application 12 displays the display format of the schedule data. To display the date. FIG. 9C shows a case where the straight line intersecting the tip of the finger area is a horizontal line, and when the straight line intersecting the tip of the finger area is a horizontal line, the calendar application 12 determines the display format of the schedule data to display the day of the week.

  When the calendar application 12 determines the display format of the schedule data, it specifies a display period for displaying the schedule data. The display period of the scheduled data is determined based on the date frame 30 where the straight line is blocked at the tip of the finger area and the display format, and the date of the date frame 30 where the straight line is blocked at the tip of the finger area is, for example, Characters in the date frame 30 whose straight line is blocked at the tip of the area can be recognized, or the position of the date frame 30 in the paper calendar 3 can be specified.

  The display period of the schedule data is specified depending on the display format of the schedule data. When the display format of the schedule data is a date format, the date in the date frame 30 where the straight line is blocked at the tip of the finger area is the schedule data. Display period. When the display format of the schedule data is week format, the date of the week including the date in the date frame 30 where the straight line is blocked at the tip of the finger area is the display period of the schedule data. When the format is the day of the week format, the date of the same day of the week as the date in the date frame 30 where the straight line is blocked at the tip of the finger area is the display period of the scheduled data.

  When the calendar application 12 determines the display format and display period of the schedule data, the calendar application 12 executes a module that functions as a schedule display, and the finger recognition unit determines the date frame 30 where the straight line is blocked at the tip of the finger area. The video imaged by the photographing means 10 is cut out in the row or column direction so as to conform to the display format of the scheduled data (S24), and the scheduled data corresponding to the scheduled data display period determined by the finger recognition unit 112 is obtained. The procedure is pasted on the cut-out video and displayed on the touch panel 1d (S25), and this procedure is terminated.

  FIG. 10 is a diagram for explaining an example of the screen of the calendar device 1 when the display format is the date format. As shown in the screen 5c of FIG. 10, when the display format of the scheduled data is a date format, the video imaged by the imaging means 10 is based on the date frame 30 where the straight line is blocked at the tip of the finger area. The image of the date frame 30 of the week including the date for displaying the schedule data is cut out in the row direction, and the schedule data for the date is ballooned so as to correspond to the position of the date specified in the display period of the schedule data. The embedded video is displayed on the touch panel 1d of the calendar device 1.

  FIG. 11 is a diagram for explaining an example of the screen of the calendar device 1 when the display format is the week format. The screen of the calendar device 1 when the display format is the week format may be the screen illustrated in FIG. 2, but FIG. 11 illustrates a screen having a form different from that in FIG. 2.

  As shown in the screen 5d of FIG. 11, when the display format of the schedule data is a week format, the video imaged by the imaging means 10 is based on the date frame 30 where the straight line is blocked at the tip of the finger area. The video of the date frame 30 of the week including the date for displaying the scheduled data is cut out in the row direction, and the date frame 30 is displayed in a column provided below the video cut out from the video taken by the photographing means 10. The schedule data of the date corresponding to is displayed in order of the schedule period.

  FIG. 12 is a diagram for explaining an example of the screen of the calendar device 1 when the display format is the day of the week format. As shown in the screen 5e of FIG. 12, when the display format of the scheduled data is the day of the week format, the video imaged by the imaging means 10 is based on the date frame 30 where the straight line is blocked at the tip of the finger area. Is cut out in the column direction, the video of the date frame 30 with the same day of the week as the date on which the scheduled data is displayed is cut out, and the schedule data list is displayed on the right side of the video cut out from the video taken by the photographing means 10 A column is provided, and the schedule data of the date corresponding to the date frame 30 is displayed in the schedule column in accordance with the schedule period.

  As described above, the calendar device 1 according to the present embodiment recognizes the month from characters indicating the month of the paper calendar 3 photographed by the camera 1f by analyzing the video of the paper calendar 3 photographed by the camera 1f. In accordance with the display format and display period of the schedule data specified by the user, the memo of the paper calendar 3 is displayed by compositing and displaying the scheduled data of the recognized month and the video of the date frame 30 included in the video of the paper calendar 3. Space can be expanded electronically.

  Further, the calendar device 1 recognizes and recognizes the finger area from the video imaged by the imaging means 10 in the case of the paper calendar 3 having the date frame and the memo space by the vertical and horizontal lines arranged in a grid pattern. Since the display format of the schedule data designated by the user is determined from the date frame 30 where the straight line is blocked at the tip of the finger area and the type of straight line blocked at the tip of the finger area, the user's intuition on the paper calendar 3 The display format can be changed and displayed by manual operation.

DESCRIPTION OF SYMBOLS 1 Calendar apparatus 10 Image | photographing means 11 Calendar means 110 Month recognition part 111 Schedule data acquisition part 112 Finger recognition part 113 Schedule display part 2 Calendar server 3 Paper calendar 30 Date frame 4 Network 6 User's finger

Claims (9)

Photographing means for photographing a paper calendar with a camera;
By recognizing a character string representing a month, the month recognition unit recognizes the month from the month recognition unit that recognizes the month of the paper calendar photographed by the photographing unit and the database that stores the schedule data. The schedule data acquisition unit for acquiring the schedule data corresponding to the selected month, and the schedule data included in the display period specified by the user in a display format specified by the user, and the paper imaged by the imaging unit A calendar means having a schedule display section for pasting and displaying on a calendar image;
A calendar apparatus comprising:   In the paper calendar, a date frame having a memo space is formed by vertical and horizontal lines arranged in a grid pattern, and the finger area obtained by finger recognition is obtained by recognizing the image captured by the photographing unit. The date frame that is blocked at the tip of the finger and the type of line that is blocked at the tip of the finger area are identified, and the display format of the scheduled data specified by the user is determined from the type of the line, 2. The calendar device according to claim 1, wherein the calendar means includes a finger recognition unit that determines a display period designated by the user from the date frame in which the date is blocked.   The calendar device according to claim 1 or 2, wherein the schedule data acquisition unit of the calendar means acquires the schedule data from a database on a network.   The month recognizing unit of the calendar means uses the current month, the next month, and the next month at the time of recognizing the month as candidate months from the clock circuit built in the calendar device, and character strings obtained by character recognition and the candidate month 4. The candidate month in which a part or all of the character string that represents the character string is recognized as the month of the paper calendar photographed by the photographing unit. 5. Calendar device according to one.   The schedule display unit of the calendar means is based on the date frame in which a straight line is blocked at the tip of the finger region, and is arranged in rows or columns so as to conform to the display format of the schedule data determined by the finger recognition unit. The video of the date frame is cut out in a direction, and the schedule data corresponding to the display period of the schedule data determined by the finger recognition unit is pasted and displayed on the cut-out video. The calendar device according to claim 1.   The finger recognition unit of the calendar means obtains the display format of the schedule data from the date frame where the straight line is blocked when the type of straight line blocked at the tip of the finger area is a horizontal line. The calendar apparatus according to claim 5, wherein a week including a given date is determined as a display period, and the schedule display unit cuts out an image of the date frame in a row direction based on the date frame.   When the type of straight line obstructed at the tip of the finger area is a vertical line, the finger recognition unit of the calendar means displays the schedule data in the day of the week display format from the date frame where the straight line is obstructed. The calendar according to claim 5 or 6, wherein a date of an obtained day of the week is determined as a display period, and the schedule display unit cuts out an image of a date frame in a column direction based on the date frame. apparatus.   The finger recognition unit of the calendar means is configured such that when the type of straight line blocked at the tip of the finger area is both a vertical line and a horizontal line, the schedule data display format is a date display and the straight line is blocked. The date obtained from the date frame is determined as a display period, and the schedule display unit cuts out the video of the date frame in a row direction based on the date frame. The calendar device according to any one of the above. A computer program for causing a computer to function as the calendar means according to any one of claims 1 to 8.

Images