JP5971003B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program.

  In recent years, in meetings and presentations, there are many opportunities for explanation while displaying materials on a PC (Personal Computer) or a tablet terminal. Participants take notes on notes and points they notice while browsing the displayed materials.

  Since there is a risk that you will not know the correspondence that you took while looking at which page of the document, taking a note at the start of the display of that slide according to the slide of the document displayed during the meeting The difference between the image and the captured image of the note at the time of display switching is extracted, difference information including the difference area image data and the captured image at the time of display switching is generated, and the slide ID and the difference information are associated and registered A conference material search support apparatus has been proposed (see Patent Document 1).

JP 2010-176603 A

  By the way, with the trend toward digitization of paper documents, memos are not only saved as notes, but are increasingly being saved as image data obtained by photographing the memos. However, if the contents of the memo recorded in the notebook are simply saved as image data as they are, it is difficult to understand when viewed later, and it is difficult to find out what is written.

  Also, if you are taking notes and you want to share the contents of the note within the group, you must take a complicated operation such as uploading the shot image to the shared storage after taking the note. It was. Or there was a possibility of forgetting to perform the process.

An object of the present invention is to transmit contents recorded on a recording medium to a predetermined transmission destination .

In order to solve the above problems, an information processing apparatus of the present invention provides:
A first housing in which a recording medium is disposed;
A second housing coupled to the first housing so as to be openable and closable;
An image pickup means provided at a position of the second case facing the first case to shoot the recording medium to generate a shot image;
Detecting means for detecting that the first casing and the second casing are closed to a predetermined angle;
Photographing control means for causing the imaging means to perform photographing at a timing when the detection means detects that the first casing and the second casing are closed to the predetermined angle;
Recognition means for recognizing a predetermined mark from said captured image generated by the image pickup means,
Transmission control means for transmitting the photographed image to a predetermined transmission destination when the predetermined mark is recognized by the recognition means;
Is provided.

According to the present invention, the content recorded on the recording medium can be transmitted to a predetermined transmission destination .

1 is an external perspective view of an information processing apparatus according to a first embodiment. It is a figure in the middle of closing a 1st cover (1st housing | casing) and a 2nd cover (2nd housing | casing). It is a block diagram which shows the functional structure of information processing apparatus. It is a figure which shows the example of a data structure of the classification mark corresponding | compatible table. It is a figure which shows the data structural example of a command mark corresponding | compatible table. It is a figure which shows the example of a data structure of a picked-up image database. It is a figure which shows the data structural example of a classification | category list. It is a flowchart which shows a mark recognition process. It is a figure which shows the example of the picked-up image obtained by image | photographing the recording medium with which the handwritten character and the handwritten mark were recorded. It is a flowchart which shows the search process classified by tag. It is a figure which shows the example of a search screen. It is a flowchart which shows a list display process. It is a figure which shows the example of an idea list screen, a decision item list screen, and a thing list screen to do. It is a flowchart which shows an automatic posting process. It is a flowchart which shows a clipping process. It is a figure which shows the example of the picked-up image obtained by image | photographing the recording medium with which the "clipping" mark was recorded. (A) is a figure which shows the state by which the information processing apparatus in 2nd Embodiment is accommodated in the main body cover. (B) is a side view showing a state in which the information processing apparatus is leaned against the main body cover. (C) is a perspective view showing a state in which the information processing apparatus is leaned against the main body cover. FIG. 11 is a diagram illustrating a state where a recording medium is placed in front of the information processing apparatus.

[First Embodiment]
First, a first embodiment of an information processing apparatus according to the present invention will be described with reference to FIGS. The present invention is not limited to the illustrated example.

FIG. 1 is an external perspective view of the information processing apparatus 1 according to the first embodiment. The information processing apparatus 1 is a tablet-type terminal device and includes a main body unit 10 and a binder 30.
The main body unit 10 is provided with a touch display unit 14 for screen display and touch input, an imaging unit 15 as an imaging unit, and the like.

  The binder 30 is configured by connecting a first cover 30a as a first housing and a second cover 30b as a second housing so that the hinge portion 30c can be opened and closed. The recording medium 40 is disposed on the first cover 30a, and the main body 10 is provided on the second cover 30b. The main body 10 and the recording medium 40 are detachably attached to the binder 30 with fasteners, hooks, and the like.

  In the present embodiment, the recording medium indicates a medium on which information to be photographed is recorded, and means a subject on which information is recorded. The recording medium also includes electronic paper that can display information electronically.

  The 1st cover 30a and the 2nd cover 30b are comprised by flat rectangular shape, and can be opened and closed so that a book and a notebook may be opened and closed by the hinge part 30c. FIG. 1 illustrates a state where the angle formed by the first cover 30a and the second cover 30b is 180 ° (open state). In this state, the user refers to the screen displayed on the touch display unit 14 and performs touch input, and enters characters, diagrams, and the like on the recording medium 40.

  The hinge portion 30c is provided with an opening / closing angle sensor 20 that detects an angle formed by the first cover 30a and the second cover 30b. The opening / closing angle sensor 20 includes a rotary encoder that detects rotation of the shaft of the hinge portion 30c, and a magnetic sensor that detects an opening / closing state using a hall element or the like.

  The recording medium 40 is a notebook or report sheet, a sheet on which a document is printed, a book, or the like used when a user takes notes. However, the recording medium 40 may be any medium on which information to be photographed is recorded, and the material is not limited to paper. The recording medium 40 may be a single sheet of paper or may be bound in a booklet.

  FIG. 2 is a view in the middle of closing the first cover 30 a and the second cover 30 b constituting the binder 30. The imaging unit 15 is provided at a position facing the first cover 30a of the main body unit 10, and an angle formed by the first cover 30a and the second cover 30b is a predetermined angle (for example, 70 °). In such a case, the recording medium 40 is imaged by the imaging unit 15. The predetermined angle is set in advance to an optimum angle for shooting, and shooting conditions such as focus and exposure are set in accordance with this angle. When the user closes the first cover 30a and the second cover 30b (when the angle formed by the first cover 30a and the second cover 30b is 0 °), the user passes a predetermined angle in the middle of closing, Shooting can be performed without the user being aware of it.

FIG. 3 is a block diagram illustrating a functional configuration of the information processing apparatus 1.
The information processing apparatus 1 includes a CPU (Central Processing Unit) as a search means, an execution means, a detection means, an imaging control means, a management means, a clipping means, a storage control means, a display control means, a reading means, a command execution means, and a transmission control means. ) 11, power supply unit 12, operation unit 13, touch display unit 14, imaging unit 15, wireless communication unit 16, RAM (Random Access Memory) 17, ROM (Read Only Memory) 18, and storage A unit 19, an opening / closing angle sensor 20, and a timer unit 21 are provided.

  The CPU 11 comprehensively controls the processing operation of each unit of the information processing apparatus 1 according to an operation signal input from the operation unit 13 or the touch display unit 14 or an instruction signal received by the wireless communication unit 16. Specifically, the CPU 11 reads out various processing programs stored in the ROM 18, develops them in the RAM 17, and performs various processes in cooperation with the programs.

The power supply unit 12 supplies power to each unit constituting the information processing apparatus 1.
The operation unit 13 includes operation keys such as a power key for turning on / off the power, and outputs an operation signal corresponding to each operation key to the CPU 11.

  The touch display unit 14 is configured by laminating a touch panel 14b on a display panel 14a serving as a display unit. The display panel 14a is composed of an LCD (Liquid Crystal Display) or the like, and performs screen display according to a display control signal from the CPU 11. The touch panel 14b detects the position of a touch operation with a user's finger or the like, and outputs an operation signal corresponding to the position to the CPU 11. The touch panel 14b receives an operation instruction from the user.

The imaging unit 15 is a digital camera that includes an optical lens, an imaging element, various sensors, and the like, and shoots a subject. The imaging unit 15 captures the recording medium 40 and generates a captured image.
The wireless communication unit 16 is a wireless communication module that connects to the Internet via a wireless LAN (Local Area Network) router and performs data communication.

The RAM 17 is a volatile memory. The RAM 17 temporarily stores various programs executed by the CPU 11 and data related to these various programs.
The ROM 18 is a read-only semiconductor memory that stores various programs and various data. The ROM 18 stores a mark recognition processing program 181 and the like.

  The storage unit 19 is configured by an HDD (Hard Disk Drive), a nonvolatile memory, or the like, and stores information in a readable and writable manner. Specifically, the storage unit 19 stores a classification mark correspondence table 191, a command mark correspondence table 192, a captured image database 193, classification lists 194a, 194b, 194c,.

FIG. 4 shows a data configuration example of the classification mark correspondence table 191, and FIG. 5 shows a data configuration example of the command mark correspondence table 192.
The classification mark correspondence table 191 associates image patterns (templates) corresponding to marks and classification items for each of a plurality of types of handwritten marks (hereinafter referred to as marks) prepared in advance for classification. Stored.
In the command mark correspondence table 192, for each of a plurality of types of marks prepared as command marks, an image pattern (template) corresponding to the mark and a command meaning the mark are stored in association with each other. .
It is desirable that the mark has a shape that can be easily recognized in distinction from other marks and characters.

  FIG. 6 shows a data configuration example of the captured image database 193. In the photographed image database 193, image data of a photographed image generated by photographing, a tag attached to the photographed image, and a creation date are stored in association with each other. The image data of the photographed image is generated in a data format such as JPEG or TIFF.

FIG. 7 shows a data configuration example of the classification lists 194a, 194b, 194c,.
In the classification list 194a, image data of a region cut out from a captured image in which an “idea” mark (see FIG. 4) is recorded, and information (file name, storage location, etc.) indicating the original image from which the region is cut out And coordinate data of a region cut out from the captured image are stored in association with each other.
In the classification list 194b, image data of a region cut out from the captured image in which the “decision item” mark (see FIG. 4) is recorded, information indicating the original image from which the region is cut out, and a cut-out image from the captured image. Are stored in association with each other.
In the classification list 194c, image data of an area cut out from the captured image in which the “to do” mark (see FIG. 4) is recorded, information indicating the original image from which the area has been extracted, and an image extracted from the captured image. Are stored in association with each other.
That is, as many classification lists 194a, 194b, 194c,... Are prepared as the number of classification mark types.

  Further, the storage unit 19 stores in advance information indicating a shared storage that is a transmission destination of a captured image in an automatic posting process (see FIG. 14) in association with an “automatic posting” mark (see FIG. 5). Yes. Further, the storage unit 19 stores in advance information indicating the shared storage that is the transmission destination of the clipping region in the clipping process (see FIG. 15) in association with the “clipping” mark (see FIG. 5). The shared storage is a data storage device connected to the communication network and capable of data communication with the information processing device 1, and allows registered members to view stored data. The transmission destination (shared storage) is specified by a path, an email address, and the like. A plurality of transmission destinations may be set according to the command.

  The opening / closing angle sensor 20 detects an angle formed by the first cover 30a and the second cover 30b, and outputs the detected angle to the CPU 11.

  The timer unit 21 has a timer circuit (RTC: Real Time Clock). The timer circuit 21 measures the current date and time and outputs it to the CPU 11.

Based on the angle output from the opening / closing angle sensor 20, the CPU 11 detects that the first cover 30a and the second cover 30b are closed to a predetermined state.
The CPU 11 causes the imaging unit 15 to perform shooting at the timing when it is detected that the first cover 30a and the second cover 30b are closed to a predetermined state.

The CPU 11 searches whether a predetermined mark is recorded for the entire area of the captured image generated by the imaging unit 15. Specifically, the CPU 11 performs an optical mark recognition process (OMR: Optical Mark Recognition) on the image data of the captured image, and detects a mark recorded on the recording medium 40. First, the CPU 11 performs binarization processing and noise removal processing on the captured image. Then, the CPU 11 reads out the template corresponding to each mark from the classification mark correspondence table 191 and the command mark correspondence table 192 stored in the storage unit 19, scans the photographed image sequentially, and stores the template in the photographed image. Check whether there is a matching area. Comparison with the template is performed with a certain width. You may enlarge / reduce / rotate the template.
The CPU 11 executes a predetermined process corresponding to the mark recognized by the search in the entire area of the captured image.

  If the recognized mark is a classification mark, the CPU 11 cuts out an area corresponding to the recognized mark from the captured image, classifies the cut out area for each type of mark, and classifies the classification in the storage unit 19. It memorize | stores in list | wrist 194a, 194b, 194c, .... Further, the CPU 11 makes a list of the clipped areas for each type of marks and displays them on the display panel 14a.

If the recognized mark is a command mark, the CPU 11 reads out the command associated with the recognized mark from the command mark correspondence table 192 stored in the storage unit 19, and the read command Is executed on the captured image.
If the recognized command mark is an “automatic posting” mark, the CPU 11 controls the wireless communication unit 16 to transmit the captured image to a predetermined shared storage.
When the recognized command mark is a “clipping” mark, the CPU 11 cuts out an area surrounded by a line recorded on the recording medium 40 from the captured image, and controls the wireless communication unit 16 to cut out the area. The specified area is transmitted to a predetermined shared storage.

  The CPU 11 assigns a tag indicating the type of the mark recognized from the captured image to the captured image, and manages the captured image for each tag.

Next, the operation in the information processing apparatus 1 will be described.
FIG. 8 is a flowchart showing mark recognition processing executed in the information processing apparatus 1. This processing is realized by software processing in cooperation with the CPU 11 and the mark recognition processing program 181 stored in the ROM 18.

  First, the CPU 11 determines whether or not it is a predetermined timing (step S1). In the first embodiment, the CPU 11 sets the opening / closing angle to a predetermined angle (for example, 70 °, etc.) based on the angle formed by the first cover 30a and the second cover 30b output by the opening / closing angle sensor 20. ) Determine whether or not: That is, the CPU 11 determines whether or not the first cover 30a and the second cover 30b constituting the binder 30 are closed to a predetermined state. If it is not the predetermined timing (step S1; NO), the process returns to step S1.

  In step S1, when it is a predetermined timing (step S1; YES), that is, when the first cover 30a and the second cover 30b are closed to a predetermined state, the CPU 11 moves the imaging unit 15 to the predetermined position. Then, the handwritten memo recorded in the recording medium 40 is photographed, and the photographed image generated by the imaging unit 15 is acquired (step S2). For example, the CPU 11 extracts a region of the recording medium 40 from the captured image, and performs a process for correcting the trapezoidal distortion on the extracted region. Further, the CPU 11 stores the image data of the captured image in the captured image database 193 of the storage unit 19, acquires the current date and time from the time measuring unit 21, and corresponds to the image data of the captured image with the acquired current date and time as the creation date and time. In addition, the captured image database 193 is stored.

  Next, the CPU 11 analyzes the image data of the photographed image and searches whether a predetermined mark is recorded for the entire region of the photographed image (step S3). Specifically, the CPU 11 recognizes the mark from the photographed image with reference to the classification mark correspondence table 191 and the command mark correspondence table 192 stored in the storage unit 19.

  Next, the CPU 11 determines whether there is a mark that has not been processed (step S4). When there is a mark that has not been processed (step S4; YES), the CPU 11 adds a tag indicating the type of the mark recognized from the captured image to the captured image (step S5). Specifically, the CPU 11 associates tags (ideas, determination items, things to do, automatic posting, clipping, etc.) corresponding to the marks recorded in the photographed image with the image data of the photographed image. It is memorized in 193.

  Next, the CPU 11 determines whether or not the mark recognized in the captured image is a command mark (step S6). When the recognized mark is not a command mark (step S6; NO), that is, when the recognized mark is a classification mark, the CPU 11 cuts out an area corresponding to the mark from the captured image (step S7). The area corresponding to the mark may be an area surrounded by a line near the mark, or an area in a range sandwiched between blank lines near the mark.

  Next, the CPU 11 adds the clipped area to the list for each mark type (step S8). Specifically, the CPU 11 stores the image data of the cutout area in the classification lists 194a, 194b, 194c,... (For example, the classification list 194a in the case of an “idea” mark). The information indicating the original image of the cutout area (the captured image for one page) and the coordinate data of the cutout area are associated with the image data of the cutout area and stored in the classification lists 194a, 194b, 194c,.

  In step S6, when the recognized mark is a command mark (step S6; YES), the CPU 11 refers to the command mark correspondence table 192 stored in the storage unit 19 and is associated with the mark. The command is read (step S9), and the read command is executed for the captured image (step S10).

After step S8 or step S10, the process returns to step S4 and the process is repeated.
In step S4, when the process has been completed for all the marks recorded in the photographed image (step S4; NO), the mark recognition process is terminated.

  FIG. 9 shows an example of a photographed image 41 obtained by photographing the recording medium 40 on which handwritten characters and marks are recorded. The mark M1 in the captured image 41 is recorded in order to classify the area A1 surrounded by the line into “ideas”. The mark M2 in the photographed image 41 is recorded in order to classify the area A2 surrounded by the line into “ideas”. The mark M3 in the captured image 41 is recorded in order to classify the area A3 surrounded by the line into “decision items”.

  In the case of the example illustrated in FIG. 9, the captured image database 193 associates the image data of the captured image 41 (for one page), the tags “idea” and “decision items”, and the creation date and time of the captured image 41. Stored. Further, the image data of the area A1 is stored in the “cutout area” of the classification list 194a corresponding to “idea”, and the captured image 41 is shown in the “original image” in association with the image data of the area A1. Information is stored, and the coordinate data of the region A1 cut out from the captured image 41 is stored in the “region coordinate data”. Similarly, the image data of the area A2 is stored in the “cutout area” of the classification list 194a corresponding to the “idea”, and the captured image 41 is associated with the image data of the area A2 and the “original image”. In the “region coordinate data”, coordinate data of the region A2 cut out from the captured image 41 is stored. Further, the image data of the area A3 is stored in the “cutout area” of the classification list 194b corresponding to the “decision item”, and the captured image 41 is associated with the image data of the area A3. In the “area coordinate data”, the coordinate data of the area A3 cut out from the captured image 41 is stored.

  Next, with reference to FIG. 10, a tag-specific search process executed in the information processing apparatus 1 will be described. The tag-specific search process is an example of a process for managing captured images for each tag assigned in step S5 of the mark recognition process.

First, the date and tag to be searched are selected by the user's operation from the touch panel 14b (step S11).
Next, the CPU 11 extracts image data of a photographed image corresponding to the selected date and tag based on the creation date and tag of the photographed image database 193 stored in the storage unit 19 (step S12).
Next, the CPU 11 causes the display panel 14a to display a photographed image that meets the search condition based on the extracted image data of the photographed image (step S13).

  FIG. 11 shows an example of the search screen 141 displayed on the display panel 14a. For example, when the date (March 14) is selected in the date designation field 141a of the search screen 141 and the tag (automatic posting) is selected in the tag designation field 141b, the photographed image is pressed. A photographed image whose creation date is “March 14” and whose tag is “automatic posting” is extracted from the database 193, and the extracted photographed images are displayed in the search result display fields 141c, 141d, and 141e, respectively. Is done. In the search result display fields 141c, 141d, and 141e, a part of the image such as the area above the captured image is displayed.

Next, CPU11 judges whether the picked-up image used as a display target was selected by operation from a user's touch panel 14b (step S14). When the captured image to be displayed is selected (step S14; YES), the CPU 11 displays the selected captured image on the display panel 14a (step S15).
For example, in the search screen 141 shown in FIG. 11, when any one of the captured images displayed as search results in the search result display fields 141c, 141d, and 141e (a part thereof) is selected. One page of the selected photographed image is displayed.

  In step S14, when the captured image to be displayed is not selected (step S14; NO), the tag-by-tag search process ends.

  Next, with reference to FIG. 12, the list display process executed in the information processing apparatus 1 will be described. The list display process is a process of listing areas cut out from the photographed image for each mark type based on the classification lists 194a, 194b, 194c,... Stored in the storage unit 19.

  First, the CPU 11 acquires the image data of the cutout area included in the corresponding classification list 194a, 194b, 194c,... For each classification mark (idea, decision item, action, etc.) (step S21). For example, for the “idea” mark, the image data of the cut-out area included in the classification list 194a is acquired. The CPU 11 stores the acquired image data of the cutout area in the RAM 17.

  Next, the CPU 11 displays a list of cutout areas on the display panel 14a based on the acquired image data of the cutout areas for each classification mark (step S22).

  FIG. 13 shows an example of an idea list screen 142, a decision item list screen 143, and a work list screen 144 displayed on the display panel 14a. In the list display fields 142a and 142b of the idea list screen 142, areas A1 and A2 cut out from the captured image 41 shown in FIG. 9 are displayed, respectively. In the example of FIG. 13, the area excluding the marks M1 and M2 included in the areas A1 and A2 in FIG. 9 is displayed, but a cutout area including the marks M1 and M2 may be displayed. In addition, an area excluding the marks M1 and M2 may be stored in advance.

  Next, the CPU 11 determines whether or not a clip region to be displayed has been selected by a user operation from the touch panel 14b (step S23). When the cutout area to be displayed is selected (step S23; YES), the CPU 11 displays a captured image including the selected cutout area on the display panel 14a (step S24). Specifically, the CPU 11 refers to the original image associated with the selected cutout area in the classification list 194a, 194b, 194c,. . Then, the CPU 11 reads out the image data of the specified captured image from the captured image database 193 stored in the storage unit 19, and displays the captured image on the display panel 14a based on the image data of the captured image.

  For example, in the idea list screen 142 shown in FIG. 13, when any one of the cutout areas displayed in the list display fields 142a, 142b,. One page of a photographed image including is displayed.

  In step S23, when the cut-out area to be displayed is not selected (step S23; NO), the list display process ends as it is.

  Next, automatic posting processing executed in the information processing apparatus 1 will be described with reference to FIG. The automatic posting process is a process corresponding to step S10 of the mark recognition process when the recognized mark is a command mark meaning “automatic posting”.

First, the CPU 11 reads the transmission destination corresponding to the “automatic posting” mark from the storage unit 19 (step S31).
Next, the CPU 11 controls the wireless communication unit 16 based on the read transmission destination, and transmits the captured image generated by the imaging unit 15 to a predetermined shared storage (step S32).
This completes the automatic posting process.

  In the shared storage, the captured image transmitted from the information processing apparatus 1 is stored and managed. After the photographed image is stored in the shared storage, the photographed image automatically posted from other registered members can be viewed.

  Next, with reference to FIG. 15, the clipping process executed in the information processing apparatus 1 will be described. The clipping process is a process corresponding to step S10 of the mark recognition process when the recognized mark is a command mark meaning “clipping”.

  First, the CPU 11 determines the orientation of the document based on the recognized “clipping” mark (step S41). Specifically, the CPU 11 determines that the upper side of the “clipping” mark shown in the command mark correspondence table 192 in FIG. 5 corresponds to the upper side of the document.

  Next, the CPU 11 cuts out a region corresponding to the mark from the captured image, specifically, a region surrounded by a line near the mark (step S42).

Next, the CPU 11 reads out the transmission destination corresponding to the “clipping” mark from the storage unit 19 (step S43).
Next, the CPU 11 controls the wireless communication unit 16 based on the read transmission destination, and transmits the area extracted in step S42 to a predetermined shared storage (step S44).
This completes the clipping process.

  FIG. 16 shows an example of a photographed image 42 obtained by photographing the recording medium 40 on which a command mark meaning “clipping” is recorded. The mark M4 in the captured image 42 is recorded for clipping the area A4 surrounded by the line. The image data of the area A4 cut out from the captured image 42 is transmitted to a predetermined shared storage.

In the shared storage, the cutout area transmitted from the information processing apparatus 1 is saved and managed. After the cutout area is saved in the shared storage, the cutout area can be viewed from other registered members.
The recording medium 40 on which the “clipping” mark is recorded is not limited to a handwritten memo, but may be a material printed in advance.

As described above, according to the information processing apparatus 1 of the first embodiment, since the predetermined process corresponding to the mark recognized from the captured image is executed, the contents recorded on the recording medium 40 are effectively used. Can be used.
Further, since it is searched whether or not a predetermined mark is recorded in the entire area of the captured image, the user can record the mark in an arbitrary area of the recording medium 40.

  In addition, by adding a tag indicating the type of mark recognized from the captured image to the captured image, the captured image can be easily managed, for example, the captured image can be searched for each tag.

If the recognized mark is a classification mark, an area corresponding to the recognized mark is extracted from the captured image, and the extracted area is classified for each type of mark, and the classification list in the storage unit 19 is used. 194a, 194b, 194c,..., The contents recorded on the recording medium 40 can be automatically classified. As a result, it becomes easy to extract or search a cutout area for each type of mark.
In addition, since the cutout areas are listed for each type of mark and displayed on the display panel 14a, it is easy to check the content recorded on the recording medium 40 for each type of mark.

If the recognized mark is a command mark, the command associated with the mark is executed, so that the user does not need to give a direct instruction and processing corresponding to the command can be easily performed.
For example, since the captured image is transmitted to a predetermined shared storage based on the “automatic posting” mark, there is no need for the user to instruct the posting process or to specify the transmission destination.
Further, based on the “clipping” mark, the area surrounded by the line is cut out and the cut out area is transmitted to a predetermined shared storage, so that the user instructs the clipping process, specifies the transmission destination, etc. Does not take much time.

  In addition, since shooting is performed at the timing when it is detected that the first cover 30a and the second cover 30b are closed to a predetermined state, it is possible to easily perform shooting.

  In addition, the detection method of the opening / closing angle of the 1st cover 30a and the 2nd cover 30b is not limited to said method. For example, an index is attached to a predetermined position of the first cover 30a, and the first cover 30a and the second cover 30b are determined based on the position of the index in the image captured by the imaging unit 15. It is good also as detecting that it was closed to this state. In addition, an acceleration sensor may be provided in the second cover 30b, and the direction of gravity may be detected by the acceleration sensor to detect the opening / closing angles of the first cover 30a and the second cover 30b.

[Second Embodiment]
Next, a second embodiment to which the present invention is applied will be described.
FIG. 17A is a diagram illustrating a state in which the information processing apparatus 1A according to the second embodiment is housed in the main body cover 50. FIGS. 17B and 17C illustrate the information processing apparatus 1A. FIG. 6 is a view showing a state where the main body cover is leaned against the main body cover 50. In the information processing apparatus 1A, the same components as those of the information processing apparatus 1 shown in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

  FIG. 18 is a diagram illustrating a state in which the information processing apparatus 1A is leaned against the main body cover 50 and the recording medium 40 is placed in front of the information processing apparatus 1A. In the second embodiment, the recording medium 40 is configured as a booklet composed of a plurality of pages, and the recording medium 40 is photographed by the imaging unit 15 at the timing of turning the pages of the recording medium 40. When the recording medium 40 is placed so that the lower end of the information processing apparatus 1A is aligned with the upper end of the recording medium 40, the angle of view and the focus of the imaging unit 15 are set in advance so as to match the recording medium 40.

  The information processing apparatus 1A is different from the information processing apparatus 1 shown in the first embodiment in that the opening / closing angle sensor 20 and the binder 30 are not necessary. Since it is the same, FIG. 3 is used and description is abbreviate | omitted. Hereinafter, a configuration and processing characteristic of the second embodiment will be described.

The CPU 11 captures moving image data continuously captured by the imaging unit 15 and analyzes the moving image data to detect a page turning operation of the recording medium 40 being captured. While the image data output from the imaging unit 15 is changing, it is estimated that each page of the recording medium 40, the user's finger, and the like are moving. The CPU 11 continues to capture the moving image data captured by the imaging unit 15 and determines that the page turning operation has been performed when the image is still.
The CPU 11 causes the imaging unit 15 to perform shooting at the timing when the page turning operation of the recording medium 40 is detected.

  The mark recognition process executed in the information processing apparatus 1A is different from the first embodiment only in the timing of shooting, and the other processes are the same as the mark recognition process shown in FIG. This will be described with reference to FIG. In the second embodiment, the CPU 11 determines whether or not the page turning operation of the handwritten memo (recording medium 40) has been detected based on the moving image data continuously captured from the imaging unit 15 in step S1. to decide.

When the page turning operation of the handwritten memo is detected (step S <b>1; YES), the CPU 11 controls the image capturing unit 15 to photograph the handwritten memo recorded in the recording medium 40, and is generated by the image capturing unit 15. The obtained memo image (still image) is acquired (step S2).
Since the process after step S3 is the same as that of the first embodiment, the description thereof is omitted.

  The tag-specific search process (see FIG. 10), list display process (see FIG. 12), automatic posting process (see FIG. 14), and clipping process (see FIG. 15) are also the same as in the first embodiment. Therefore, the description is omitted.

  As described above, according to the information processing apparatus 1A of the second embodiment, in addition to the same effects as those of the first embodiment, shooting is performed at the timing when the page turning operation of the recording medium 40 is detected. Therefore, photographing can be performed easily.

  Note that the method of detecting the page turning operation is not limited to the above method. For example, when a page specifying mark for specifying a page is previously attached to a predetermined position of each page of the recording medium 40, and the page specifying mark is detected from a predetermined position in the captured image. Alternatively, it may be determined that the page turning operation has been performed.

  The description in each of the above embodiments is an example of the information processing apparatus according to the present invention, and the present invention is not limited to this. The detailed configuration and detailed operation of each part constituting the apparatus can be changed as appropriate without departing from the spirit of the present invention.

  For example, the mark recorded on the recording medium 40 is not limited to the above example. The classification mark can be added to the classification mark correspondence table 191 together with the corresponding classification item. Further, command marks can be added to the command mark correspondence table 192 together with corresponding commands.

  Further, in the automatic posting process (see FIG. 14) and the clipping process (see FIG. 15), the transmission destination corresponding to the mark is read from the storage unit 19, and the captured image and the clipping region are automatically set in the transmission destination set in advance. The transmission may be performed, but a setting screen for setting the transmission destination may be displayed before transmission, and the user may select the transmission destination.

  In the above description, an example in which a ROM is used as a computer-readable medium storing a program for executing each process is disclosed, but the present invention is not limited to this example. As other computer-readable media, a non-volatile memory such as a flash memory and a portable recording medium such as a CD-ROM can be applied. A carrier wave may be applied as a medium for providing program data via a communication line.

Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and the equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Imaging means for capturing a recording medium and generating a captured image;
Search means for searching whether or not a predetermined handwritten mark is recorded for the entire area of the captured image generated by the imaging means;
Execution means for executing a predetermined process according to the handwritten mark recognized by the search;
An information processing apparatus comprising:
<Claim 2>
A first housing in which the recording medium is disposed;
A second housing which is connected to the first housing by a hinge portion so as to be openable and closable and provided with a main body portion;
Detecting means for detecting that the first casing and the second casing are closed to a predetermined state;
With
The imaging means is provided at a position facing the first housing of the main body,
An imaging control unit that causes the imaging unit to perform imaging at a timing when the detection unit detects that the first casing and the second casing are closed to the predetermined state;
The information processing apparatus according to claim 1.
<Claim 3>
The recording medium is configured in a booklet shape including a plurality of pages,
Detecting means for detecting a page turning operation of the recording medium;
Photographing control means for causing the imaging means to perform photographing at the timing when the page turning operation of the recording medium is detected by the detection means;
Comprising
The information processing apparatus according to claim 1.
<Claim 4>
A tag that indicates a type of the recognized handwritten mark to the captured image, and a management unit that manages the captured image for each tag;
The information processing apparatus according to any one of claims 1 to 3.
<Claim 5>
The execution means includes
Clipping means for cutting out an area corresponding to the recognized handwritten mark from the captured image;
Storage control means for classifying the cut-out area for each type of handwritten mark and storing it in the storage means;
Comprising
The information processing apparatus according to any one of claims 1 to 4.
<Claim 6>
A display control unit configured to list the clipped area stored in the storage unit for each type of the handwritten mark and display the list on the display unit;
The information processing apparatus according to claim 5.
<Claim 7>
A storage means for storing a command associated with the handwritten mark in association with each type of the handwritten mark;
The execution means includes
Reading means for reading out a command associated with the recognized handwritten mark from the storage means;
Command execution means for executing the read command on the captured image;
Comprising
The information processing apparatus according to any one of claims 1 to 4.
<Claim 8>
The command execution means includes transmission control means for transmitting the captured image to a predetermined shared storage.
The information processing apparatus according to claim 7.
<Claim 9>
The command execution means includes
Clipping means for cutting out an area surrounded by a line recorded on the recording medium from the captured image;
Transmission control means for transmitting the extracted area to a predetermined shared storage;
Comprising
The information processing apparatus according to claim 7.
<Claim 10>
Computer
Search means for searching whether or not a predetermined handwritten mark is recorded for all areas of the photographed image generated by the imaging means for photographing the recording medium and generating a photographed image;
Execution means for executing predetermined processing according to the handwritten mark recognized by the search;
Program to function as.

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 1A Information processing apparatus 10 Main-body part 11 CPU
12 power supply unit 13 operation unit 14 touch display unit 14a display panel 14b touch panel 15 imaging unit 16 wireless communication unit 17 RAM
18 ROM
DESCRIPTION OF SYMBOLS 19 Memory | storage part 20 Opening / closing angle sensor 21 Time measuring part 30 Binder 30a 1st cover 30b 2nd cover 30c Hinge part 40 Recording medium 50 Main body cover 181 Mark recognition process program 191 Classification mark corresponding table 192 Command mark corresponding table 193 Photographed image Database 194a, 194b, 194c, ... Classification list

Claims (4)

A first housing in which a recording medium is disposed;
A second housing coupled to the first housing so as to be openable and closable;
An image pickup means provided at a position of the second case facing the first case to shoot the recording medium to generate a shot image;
Detecting means for detecting that the first casing and the second casing are closed to a predetermined angle;
Photographing control means for causing the imaging means to perform photographing at a timing when the detection means detects that the first casing and the second casing are closed to the predetermined angle;
Recognition means for recognizing a predetermined mark from the captured image generated by the imaging means;
Transmission control means for transmitting the photographed image to a predetermined transmission destination when the predetermined mark is recognized by the recognition means;
An information processing apparatus comprising: The transmission control means reads a transmission destination corresponding to the predetermined mark, and causes the captured image to be transmitted to the read transmission destination.
The information processing apparatus according to claim 1 . The transmission control unit cuts out an area surrounded by a line recorded on the recording medium from the captured image, and causes the cut out area to be transmitted to a predetermined transmission destination.
The information processing apparatus according to claim 1 or 2 . A first housing in which a recording medium is arranged, a second housing connected to the first housing so as to be openable and closable, and a position of the second housing facing the first housing A computer of an information processing apparatus provided with an image pickup unit that is provided on the image pickup unit and shoots the recording medium to generate a shot image;
Detecting means for detecting that the first casing and the second casing are closed to a predetermined angle;
Photographing control means for causing the imaging means to perform photographing at a timing when the detection means detects that the first casing and the second casing are closed to the predetermined angle;
Recognition means for recognizing a predetermined mark from the captured image generated by the imaging means;
Transmission control means for transmitting the photographed image to a predetermined transmission destination when the predetermined mark is recognized by the recognition means;
Program to function as.

Images