JP2020102120A - Information processing apparatus, control method, and program - Google Patents

Abstract

To provide a mechanism that appropriately acquires an image to be composited with a photographed image.SOLUTION: An information processing apparatus comprises: photographing means; and display means that displays a range of photographing performed by the photographing means. The information processing apparatus includes: detection means that detects a partial area meeting a predetermined condition from an image of a first object obtained through photographing performed by the photographing means; display control means that, when the photographing means photographs a second object, displays a boundary indicating the shape of the detected partial area on the photographing range displayed by the display means; and extraction means that extracts a partial image according to the displayed boundary from an image of the second object obtained through photographing performed by the photographing means.SELECTED DRAWING: Figure 14

Description

The present invention relates to a technique for appropriately combining a plurality of images with a captured image.

In recent years, pharmaceutical companies have been carrying out pharmaceutical safety information management work (PV work), which is information management work on “side effects of drugs”. Specifically, as a post-marketing surveillance, a medical information representative (MR) of a pharmaceutical company was asked about side effects of a drug provided by the pharmaceutical company and infectious diseases suspected to be caused by the use of the drug. Give the doctor the questionnaire to fill out and fill it out, and after a specified period, go to the hospital and collect it.

The MR sends the survey form to the head office by FAX from a convenience store near the hospital, and sends and registers the data from the head office to the Pharmaceuticals and Medical Devices Agency, which is an independent administrative agency. Reports on side effects and infectious diseases. If there is no FAX-capable terminal nearby, the MR returns to the sales office once and sends the data of the survey form to the head office by FAX from the FAX machine installed in the sales office. This research/reporting work is carried out in accordance with the Pharmaceutical Affairs Law.

In order to save the trouble of searching for the FAX machine, some companies have adopted a system in which a survey form is taken with a smart device and the taken picture is transmitted to the server at the head office. When creating a survey form that includes drawings and photos, create a single survey form by taking a survey form with a photo attached in advance, synthesizing a rectangular image that is embedded in the captured image, etc. .. For example, Patent Document 1 discloses a technique of acquiring a rectangular area from a first image, converting the second image so as to fit the rectangular area, and combining the images.

JP, 2009-80619, A

With the mechanism described in Patent Document 1, it is possible to convert the image of the second image so as to match the rectangular region of the captured first image and combine the images. However, there is a problem that a part of the original image is lost or the entire image is distorted because the image is cut out in accordance with the rectangular area or the shape is converted according to the aspect ratio of the rectangular area.

In order to solve such a problem, it is desirable to capture an image to be fitted in a rectangular area in a shape that matches the aspect ratio of the rectangular area.

Therefore, an object of the present invention is to provide a mechanism for appropriately acquiring an image to be combined with a captured image.

The present invention is an information processing apparatus comprising a photographing means and a display means for displaying a photographing range by the photographing means, wherein an image of the first object obtained by the photographing by the photographing means meets a predetermined condition. When a second object is photographed by the photographing means and a detection means for detecting a matching partial area, a boundary indicating the shape of the detected partial area is displayed on the photographing range displayed by the display means. It is characterized by comprising display control means and extraction means for extracting a partial image from the image of the second object obtained by photographing by the photographing means according to the displayed boundary.

According to the present invention, it is possible to provide a mechanism for appropriately acquiring an image to be combined with a captured image.

FIG. 1 is a system configuration diagram showing an example of a system configuration of an information processing system in an embodiment of the present invention. FIG. 3 is a hardware configuration diagram showing an example of a hardware configuration of the mobile terminal 100 according to the embodiment of the present invention. It is a hardware block diagram which shows an example of the hardware constitutions of the server 200 in embodiment of this invention. It is a flow chart which shows an example of the whole processing in an information processing system in an embodiment of the present invention. It is a flow chart which shows an example of rectangle detection processing in an information processing system in an embodiment of the present invention. It is a flow chart which shows an example of screen adjustment processing in an information processing system in an embodiment of the present invention. 6 is a flowchart showing an example of image combining processing and image display processing in the information processing system in the embodiment of the present invention. It is a block diagram which shows the structure of the picked-up image table in embodiment of this invention. It is a block diagram which shows the structure of a rectangular table in embodiment of this invention. 6 is a screen example of a shooting screen in the embodiment of the present invention. It is an example of a rectangle detection in the embodiment of the present invention. 7 is a screen example of a rectangular photographing screen in the embodiment of the present invention. 6 is a screen example of a captured image confirmation screen in the embodiment of the present invention. It is a block diagram showing an example of composition of a module of personal digital assistant 100 in an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system configuration diagram showing an example of the configuration of an information processing system according to an embodiment of the present invention.

The information processing system in the embodiment of the present invention is configured such that a mobile terminal 100 and a server 200 are communicably connected via a network 101 (for example, WAN=wide area network).

The mobile terminal 100 is an information processing device that captures and stores a booklet (corresponding to an object to be imaged) with a camera and transmits the booklet to the server 200 via the network 101. The mobile terminal 100 also includes a touch panel 210.

The server 200 is a device that receives a plurality of images transmitted from the mobile terminal 100, converts the images into one PDF file, and saves the PDF file.

This is the end of the description of the system configuration diagram shown in FIG.

The hardware configuration of the mobile terminal 100 shown in FIG. 1 will be described below with reference to FIG.

The CPU 201 centrally controls each device and controller connected to the system bus 204.

Further, the ROM 202 or the flash memory 214 has a control program of the CPU 201, such as a BIOS (Basic Input/Output System), an operating system program (hereinafter, OS), and a later-described necessary for realizing the function executed by the mobile terminal. Various programs to be executed are stored. The RAM 203 functions as a main memory, a work area, etc. of the CPU 201.

The CPU 201 implements various operations by loading a program or the like required for executing the processing into the RAM 203 and executing the program.

The input controller 205 also controls inputs from the touch panel 210, the microphone 211, and the camera 212. The touch panel 210 controls inputs related to a user's touch operation, the microphone 211 controls input of voice, and the camera 212 controls input of captured still image and moving image. The output controller 206 controls output to the touch panel 210 and the speaker 213.

The touch panel 210 detects a touch operation from the user and displays the image sent from the output controller 206 described above. The touch panel 210 is a component in which a display and a position input device are integrated. It is also possible to detect a touch operation (hereinafter referred to as multi-touch) on a plurality of locations.

A memory controller (MC) 207 controls access to a flash memory 214 that stores a boot program, browser software, various applications, font data, user files, edit files, various data, and the like. Although a flash memory is described in the present embodiment, a storage medium such as a hard disk (HD), a flexible disk (FD), or a card-type memory connected to a PCMCIA card slot via an adapter may be used.

The communication I/F controller 209 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, internet communication using TCP/IP is possible.

The sensor controller 208 controls an input from the sensor 215 included in the mobile terminal 100. Various sensors exist in the sensor 215 of the mobile terminal 100, and are, for example, an azimuth sensor and an acceleration sensor.

Note that the CPU 201 enables display on the touch panel 210 by executing outline font rasterization processing in a display information area in the RAM 203, for example.

Various programs used for the mobile terminal 100 of the present invention to execute various processes described later are recorded in the flash memory 214, and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. .. Furthermore, definition files and various information tables used by the program according to the present invention are stored in the flash memory 214.

This is the end of the description of the hardware configuration of the mobile terminal 100 shown in FIG. The above configuration is an example, and can be appropriately changed according to the purpose and use.

The hardware configuration of the server 200 shown in FIG. 1 will be described below with reference to FIG.

As illustrated in FIG. 3, the server 200 includes a CPU (Central Processing Unit) 301, a RAM (Random Access Memory) 302, a ROM (Read Only Memory) 303, an input controller 305, a video controller 306, and a memory via a system bus 304. A configuration is adopted in which the controller 307, the communication I/F controller 308, etc. are connected.

The CPU 301 centrally controls each device and controller connected to the system bus 304.

Further, the ROM 302 or the external memory 311 will be described later, which is necessary to realize a function executed by a control program of the CPU 301, such as a BIOS (Basic Input/Output System), an OS (Operating System), or each server or each PC. Various programs are stored. In addition, information necessary for carrying out the present invention is stored. The external memory may be a database.

The RAM 303 functions as a main memory, a work area, etc. of the CPU 301. The CPU 301 implements various operations by loading a program or the like required for execution of processing from the ROM 302 or the external memory 311 to the RAM 303 and executing the loaded program.

The input controller 305 controls inputs from a keyboard (KB) 309 and a pointing device such as a mouse (not shown).

The video controller 306 controls display on a display such as the display 310. The display may be a display such as a liquid crystal display. These are used by the administrator as needed.

The memory controller 307 is an external storage device (hard disk (HD)) that stores a boot program, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA (Personal Computer). Controls access to an external memory 311 such as a CompactFlash (registered trademark) memory that is connected to a Memory Card International Association) card slot via an adapter.

The communication I/F controller 308 connects/communicates with an external device via a network and executes communication control processing on the network. For example, communication using TCP/IP (Transmission Control Protocol/Internet Protocol) is possible.

The CPU 301 can display the outline font on the display 310, for example, by executing an outline font rasterizing process in the display information area in the RAM 303. Further, the CPU 301 enables a user instruction with a mouse cursor (not shown) or the like on the display 310.

Various programs to be described later for implementing the present invention are recorded in the external memory 311, and are executed by the CPU 301 by being loaded into the RAM 303 as needed.

This is the end of the description of the hardware configuration of the server 200 shown in FIG. The above configuration is an example, and can be appropriately changed according to the purpose and use.

A block diagram showing an example of the configuration of the module of the mobile terminal 100 according to the embodiment of the present invention will be described below with reference to FIG.

The mobile terminal 100 includes a photographing unit 1401, a storage unit 1402, a rectangle detection unit 1403, a screen adjustment unit 1404, an image composition unit 1405, and a display unit 1406, and an image storage application is installed.

The image capturing unit 1401 is a functional unit that controls image capturing.

The storage unit 1402 is a functional unit that controls to store a plurality of captured images.

The rectangle detection unit 1403 is a functional unit that detects the contour line from the object to be imaged and controls the size and the position coordinate in the image.

The screen adjustment unit 1404 is a functional unit that controls to determine the orientation of the shooting screen, the resolution of the camera, and the position at which the shooting guide area is displayed, based on the rectangle determined by the rectangle detection unit 1403.

The image composition unit 1405 is a functional unit that controls to compose a rectangular image with the captured image stored in the storage unit 1402.

The display unit 1406 is a functional unit that controls to display the image combined by the image combining unit 1405.

This is the end of the description of the block diagram showing the exemplary configuration of the module of the mobile terminal 100 shown in FIG.

The processing executed by the mobile terminal 100 according to the embodiment of the present invention will be described below with reference to the flowcharts shown in FIGS. 4 to 7.

FIG. 4 is a flowchart showing an example of the overall processing by the mobile terminal 100.

In step S401, the mobile terminal 100 shoots a form, which is a shooting target, and detects a rectangular area from the acquired image. Details of this processing will be described later with reference to FIG.

In step S402, the mobile terminal 100 captures an image by capturing an object to be combined with the detected rectangular area. Details of this processing will be described later with reference to FIG.

In step S403, the mobile terminal 100 combines and displays the image acquired in step S402 with the rectangular area detected from the image of the form acquired in step S401. Details of this processing will be described later with reference to FIG. 7.

In step S404, the mobile terminal 100 transmits the data of the entire image combined in step S403 to the server 200. Here, the whole image data after the composition may be transmitted as in the present embodiment, or each image data before the composition may be transmitted together with information (composition position, size) necessary for the composition. ..

This is the end of the description of the flowchart shown in FIG.

FIG. 5 is a flowchart showing an example of a process in step S401 in which the mobile terminal 100 displays a photographing screen, photographs an object to be photographed, detects a contour line from the photographed image, and specifies its size and position coordinates in the image. Is.

In step S501, the CPU 201 of the mobile terminal 100 activates the shooting application stored in the mobile terminal 100 according to the operation by the user, and displays the shooting screen.

Specifically, the shooting screen is displayed in response to the reception of the display operation of the shooting screen from the menu screen (not shown) displayed after the image storage application is activated. Further, the display of the photographing screen is terminated by terminating the image storage application or accepting an operation of ending the photographing screen.

An example of the shooting screen is shown in FIG. Details of FIG. 10 will be described later.

In step S502, the CPU 201 of the mobile terminal 100 photographs the object to be photographed by the camera 212, and temporarily stores it in the RAM 303 or the like. Specifically, the shutter operation is received from the user, or it is detected that the object to be photographed has entered the photographing range, and the photographing is performed.

In step S503, the CPU 201 of the mobile terminal 100 acquires and corrects the image temporarily stored in step S502. Specifically, the shape of the image is recognized such that the vertices of the object to be photographed in the acquired image are recognized and the recognized vertices are matched with the vertices of a rectangle indicating the shape of the A4 vertical and A3 horizontal sheets. Correct the deformation. In the present embodiment, a form using A4 portrait or A3 landscape size paper as an object to be photographed is handled.

In step S504, the CPU 201 of the mobile terminal 100 detects a rectangular area included in the image corrected in step S503. Specifically, the contour line in the image is recognized, and the rectangular area surrounded by the contour line is detected.

In step 505, the CPU 201 of the mobile terminal 100 determines whether or not a rectangular area has been detected. If detected, the processing proceeds to the next step, and if no rectangular area is detected, the processing proceeds to step S508.

Steps S506 to S507 are repeated for each rectangular area detected in step S504.

In step S506, the CPU 201 of the mobile terminal 100 determines whether or not a certain amount of pixels of the same color are included in the area inside the detected contour line, and if so, the position and size of the contour line in the captured image. Information is acquired and the process proceeds to step S507. Although it was detected as a rectangular area, if there are not more than a certain amount of pixels of the same color inside the rectangular area, for example, if it is surrounded by a line to emphasize the sentence, or if it is a frame line of the entry field. In this case, since it is not the image insertion area, the process moves to the next rectangular area.

An example of rectangle detection is shown in FIG. Details of FIG. 11 will be described later.

In step S507, the CPU 201 of the mobile terminal 100 stores the position and size of the rectangle detected in step S504 and determined as the image insertion area in step S506 in the rectangle table shown in FIG. The rectangular table 900 includes a form ID 903, a rectangular ID 904, a position 901, and a size 902. The form ID 903 is an alphanumeric character that uniquely represents the photographed form, and the rectangle ID 904 is a serial number assigned to each rectangle for one form. The rectangle ID 904 corresponds to the number of the rectangle image path in the captured image table 800. The position 901 is the position coordinate of the rectangle detected in steps S504 to S506 in the captured image captured in step S502. The size 902 is the size of the rectangle detected in steps S504 to S506.

In step S508, the CPU 201 of the mobile terminal 100 stores the image temporarily stored in step S502 in the captured image table shown in FIG. The photographed image table 800 includes a form ID 805, a photographing date/time 801, an image path 802, a rectangular image path (1) 803, and a rectangular image path (2) 804. The form ID 805 is an identification alphanumeric character uniquely representing the photographed form, and the photographing date/time 801 is the photographing date/time of photographing the object to be photographed in S502. The image path 802 is a path indicating the location where the image of the object photographed in S502 is stored. The rectangular image path (1) 803 and the rectangular image path (2) 804 are paths that represent the locations where the rectangular images captured by the processing of the flowchart shown in FIG. 6 are stored, and in FIG. Although not described, save the paths for the number of detected rectangular images.

This is the end of the description of the flowchart shown in FIG.

Hereinafter, the flowchart shown in FIG. 6 will be described.

FIG. 6 is a flowchart showing an example of a process in which, in step S403, the mobile terminal 100 captures an image by photographing a synthesis target object to be fitted into the rectangle according to the rectangle detected by the process of the flowchart shown in FIG. ..

In step S601, the CPU 201 of the mobile terminal 100 acquires the size information of the rectangle stored in step S507 from the rectangle table shown in FIG.

In step S602, the CPU 201 of the mobile terminal 100 determines the presence/absence of rectangle information, and when the rectangle information exists, the process proceeds to the next step. If there is no rectangle information, this processing flow ends.

The processes of steps S603 to S610 are repeated for each piece of rectangular information acquired in step S601.

In step S603, the CPU 201 of the mobile terminal 100 calculates the aspect ratio of the rectangle.

When the rectangle calculated in step S603 is vertically long, the CPU 201 of the mobile terminal 100 sets the shooting screen to be portrait in step S604. When the rectangle calculated in step S603 is horizontally long, the CPU 201 of the mobile terminal 100 sets the shooting screen to be horizontal in step S605. By changing the orientation of the shooting screen according to the aspect ratio of the rectangle, it is possible to secure a wider shooting area according to the rectangle.

In step S606, the CPU 201 of the mobile terminal 100 selects and sets the resolution closest to the size of the rectangle calculated in step S603 from the camera resolutions. By matching the size of the rectangle and the resolution of the camera, it is possible to make the appearance at the time of shooting the rectangle and the appearance of the rectangular area in the composite image in which the rectangle is embedded closer.

In step S607, the CPU 201 of the mobile terminal 100 draws a shooting guide frame on the shooting screen. The size of the aspect ratio calculated in step S603 is set for the shooting guide frame in order to secure a wider shooting area and to make the rectangular area in the composite image in which the rectangle is filled look closer to the appearance in rectangular shooting. Then, it is displayed in the maximum area that can be taken in the shooting screen.

FIG. 12 shows an example of the vertically long rectangular shooting screen and the horizontally long rectangular shooting screen. Details of FIG. 12 will be described later.

In step S608, the CPU 201 of the mobile terminal 100 captures an image of the composition target with the camera 212, and temporarily stores the captured image in the RAM 303 or the like.

In step S609, the CPU 201 of the mobile terminal 100 cuts out the area of the shooting guide frame drawn in step S607 from the shot image temporarily stored in step S608.

In step S610, the CPU 201 of the mobile terminal 100 stores the image cut out in step S609 in the captured image table shown in FIG.

This is the end of the description of the flowchart shown in FIG.

Hereinafter, the flowchart shown in FIG. 7 will be described.

In FIG. 7, the rectangular image obtained by photographing the combination target by the processing of the flowchart shown in FIG. 6 is combined with the image obtained by photographing the form by the processing of the flowchart shown in FIG. 7 is a flowchart showing an example of processing for displaying the combined image on the captured image confirmation screen.

In step S701, the CPU 201 of the mobile terminal 100 acquires the image path of the captured image stored in step S508 from the captured image table shown in FIG.

In step S702, the CPU 201 of the mobile terminal 100 acquires a captured image from the image path.

In step S703, the CPU 201 of the mobile terminal 100 acquires the position and size information of the rectangle stored in step S507 from the rectangle table shown in FIG.

In step S704, the presence/absence of rectangle information is determined. If rectangle information is present, the process proceeds to the next process. If the rectangle information does not exist, the process proceeds to step S708.

The processing of steps S705 to S707 is repeated for each piece of rectangular information acquired in step S703.

In step S705, a rectangular image path is acquired from the captured image table shown in FIG.

In step S706, the CPU 201 of the mobile terminal 100 acquires a rectangular image from the rectangular image path acquired in step S705.

In step S707, the CPU 201 of the mobile terminal 100 combines the rectangular image acquired in step S706 with the rectangular position acquired in step S703 in the captured image acquired in step S702. By repeatedly executing steps S705 to S707 for all the rectangles detected in the flowchart shown in FIG. 5, all the rectangle images are combined with the captured image.

In step S708, the CPU 201 of the mobile terminal 100 displays one image in which all rectangular images are combined in the rectangular area of the captured image on the captured image confirmation screen. If the rectangle information does not exist, the image of the original form is displayed as it is.

FIG. 13 shows an example of the captured image confirmation screen. Details of FIG. 13 will be described later.

This is the end of the description of the flowchart shown in FIG. 7.

The screen configuration diagrams shown in FIGS. 10 to 13 will be described below.

FIG. 10 is an example of a photographing screen for photographing the object to be photographed by the processing of the flowchart shown in FIG. The photographing screen 1000 is composed of a photographing object 1001, contour lines 1002 to 1004, and a photographing guide frame 1005. The object 1001 to be imaged is A4 paper, but A3 paper can also be imaged on a landscape image screen. The contour line 1002 and the contour line 1004 are rectangular areas for inserting the rectangular image, and the contour line 1003 is a non-target rectangular area for inserting the rectangular image. In order to guide the user to an appropriate shooting position, a shooting guide frame 1005 is displayed according to the shooting target.

FIG. 11 is an example of detecting a rectangular area from an object to be photographed by the processing of the flowchart shown in FIG. The imaging target 1101 is composed of a contour line 1102 and a contour line 1103. The photographed image 1104 is an image of the photographed object itself. The rectangular area 1105 is an area in which the area of the contour line 1102 is detected and cut out from the imaging target 1101. The rectangular area 1106 is an area in which the area of the contour line 1103 is detected and cut out from the imaging target 1101.

FIG. 12 is an example of a rectangular photographing screen in which the rectangular aspect ratio is determined by the processing of the flowchart shown in FIG. 6 and the screen display is adjusted according to the rectangular information. When the rectangle is vertically long, the vertically long rectangle shooting screen 1200 is displayed, and the shooting guide frame 1202 is displayed in the maximum area that can be taken in the shooting screen with the aspect ratio of the rectangle 1201. When the rectangle is horizontally long, the horizontally long rectangle photographing screen 1210 is displayed, and the photographing guide frame 1212 is displayed in the maximum area that can be taken within the photographing screen with the aspect ratio of the rectangle 1211.

FIG. 13 is an example of a photographed image confirmation screen that displays the photographed screen combined in the process of the flowchart shown in FIG. 7. The captured image confirmation screen 1300 is composed of a rectangular area 1301 and a rectangular area 1302. The rectangular area 1301 is combined with a vertically long rectangular image taken on the vertically long rectangular shooting screen 1200, and the rectangular area 1302 is combined with a horizontally long rectangular image taken on the horizontally long rectangular shooting screen 1210.

As described above, it is possible to appropriately acquire the image to be combined with the captured image.

It is needless to say that the structure and contents of the various data described above are not limited to this, and may be composed of various structures and contents according to the use and purpose.

Although some embodiments have been described above, the present invention can be embodied as, for example, a system, an apparatus, a method, a computer program, a recording medium, or the like, and more specifically, a plurality of devices. The present invention may be applied to a system configured by, or may be applied to a device including one device.

Further, the computer program according to the present invention is a computer program that allows a computer to execute the processing method shown in each of the drawings, and the storage medium according to the present invention is a computer program that allows the computer to execute the processing method shown in FIGS. 9 to 10. Is remembered. The computer program in the present invention may be a computer program for each processing method of each device in each drawing.

As described above, a computer in which a recording medium recording a computer program that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus is stored in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing the program.

In this case, the computer program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the computer program constitutes the present invention.

As a recording medium for supplying the computer program, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD-ROM, a magnetic tape, a non-volatile memory card, a ROM, a silicon disk. , A solid state drive, etc. can be used.

Further, not only the functions of the above-described embodiments are realized by executing the computer program read by the computer, but also an OS (operating system) or the like running on the computer is executed based on the instructions of the computer program. It goes without saying that a case where some or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

Furthermore, after the computer program read from the recording medium is written in the memory provided in the function extension board inserted in the computer or the function extension unit connected to the computer, the function is executed based on the instruction of the computer program code. Needless to say, this also includes the case where the CPU or the like included in the expansion board or the function expansion unit performs some or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

Further, the present invention may be applied to a system including a plurality of devices or an apparatus including one device. It goes without saying that the present invention can also be applied to the case where it is achieved by supplying a computer program to a system or apparatus. In this case, by reading the recording medium storing the computer program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

Furthermore, by downloading and reading a computer program for achieving the present invention from a server, a database or the like on a network using a communication program, the system or device can enjoy the effects of the present invention.

It should be noted that the present invention also includes all configurations that combine the above-described embodiments and modifications thereof.

100 mobile terminal 101 network 200 server

Claims (9)

An information processing apparatus comprising: a photographing means and a display means for displaying a photographing range by the photographing means,
Detection means for detecting a partial area satisfying a predetermined condition from the image of the first object obtained by the photographing by the photographing means;
Display control means for displaying a boundary indicating the shape of the detected partial region on the imaging range displayed by the display means when the second object is imaged by the imaging means;
An information processing device for extracting a partial image from the image of the second object obtained by photographing by the photographing means according to the displayed boundary. The information processing apparatus according to claim 1, further comprising a determining unit that determines an orientation of an image obtained by capturing an image of the second object by the image capturing unit based on an aspect ratio of the detected partial region. .. The information processing apparatus according to claim 1, wherein the display control unit adjusts the size of the boundary to be displayed according to the image capturing range to be displayed. The composite image display means for displaying an image in which the extracted partial image is inserted is provided in the partial region of the obtained image of the first target object. The information processing device according to 1. The information processing apparatus according to claim 1, wherein the partial area has a rectangular shape. The information processing apparatus according to claim 1, wherein the image of the first object is newly obtained. The information processing apparatus according to any one of claims 1 to 6, wherein the first object is a document. A method of controlling an information processing apparatus, comprising: a photographing means; and a display means for displaying a photographing range of the photographing means,
A detecting step in which the detecting means detects a partial area satisfying a predetermined condition from the image of the first object obtained by the photographing by the photographing means;
A display control step of displaying a boundary indicating the shape of the detected partial area on the imaging range displayed by the display means when the display control means images the second object by the imaging means;
An extracting step of extracting a partial image from the image of the second object obtained by the photographing by the photographing means according to the displayed boundary, the control method of the information processing apparatus. A program executable in an information processing device, comprising: a photographing means and a display means for displaying a photographing range by the photographing means,
The information processing device,
Detection means for detecting a partial area satisfying a predetermined condition from the image of the first object obtained by the photographing by the photographing means;
Display control means for displaying a boundary indicating the shape of the detected partial region on the imaging range displayed by the display means when the second object is imaged by the imaging means;
A program for functioning as extraction means for extracting a partial image from the image of the second object obtained by photographing by the photographing means according to the displayed boundary.

Images