JP6802504B1 - Information processing device, control method, program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism for appropriately fixing the vertical and horizontal directions to be photographed when photographing a subject which needs to be distinguished in the vertical and horizontal directions. SOLUTION: The information processing device includes a shooting means for switching the vertical and horizontal directions for shooting depending on the state of the own device, and the mode determining means for determining a shooting mode including the vertical and horizontal directions for shooting is determined. A fixed determination means for determining whether to fix the vertical and horizontal orientations for shooting corresponding to the shooting mode, and a vertical and horizontal shooting according to the state of the own device according to the result determined by the fixed determination means at the time of shooting by the shooting means. It is characterized by including a switching control means for controlling whether to switch the direction. [Selection diagram] FIG. 9

Description

Regarding.

In recent years, pharmaceutical companies have been engaged in pharmaceutical safety information management business (PV business), which is information management business regarding "side effects of drugs". Specifically, as a post-marketing surveillance, a medical representative (MR) of a pharmaceutical company will discuss side effects of the drug provided by the drug company and infectious diseases suspected to be caused by the use of the drug. Give the questionnaire to the doctor to fill out, and after a certain period of time, go to the hospital to collect it.

Then, for example, the MR sends the questionnaire to the head office by fax from a convenience store near the hospital, and the head office sends and registers the data to the Pharmaceuticals and Medical Devices Agency to send the drug to the head office. Report side effects and infectious diseases. If there is no terminal that can be faxed nearby, the MR returns to the sales office and sends the survey form data to the head office by fax from the fax device installed at the sales office. This investigation / reporting work is carried out in accordance with the Pharmaceutical Affairs Law.

In order to save the trouble of searching for this fax machine, some companies have adopted a system that takes a survey form with a smart device and sends the taken picture to the server at the head office. When taking a picture, the direction of the object to be taken and the top and bottom of the shooting screen on the smart device are aligned appropriately before taking the picture. Regarding the orientation of the shooting screen and the shooting object, for example, Patent Document 1 discloses a technique for determining whether an image is in a horizontal posture or a vertical posture even when the camera is shot upward or downward. ..

International Publication No. 2006/100804

However, in the method described in Patent Document 1, if the tilt or orientation of the camera is erroneously detected due to camera shake or the like during shooting, the shooting is performed with the direction of the shooting screen and the direction of the shooting object deviated from each other. There is a problem.

In order to solve such a problem, it is desirable to fix the direction of the shooting screen at the time of shooting and shoot in the correct direction as intended by the shooting target.

Therefore, an object of the present invention is to provide a mechanism for appropriately fixing the vertical and horizontal directions to be photographed when photographing a subject that needs to be distinguished in the vertical and horizontal directions.

An information processing device including a shooting means for switching the vertical and horizontal directions of shooting according to the state of the own device, and the mode determining means for determining the shooting mode including the vertical and horizontal directions for shooting and the determined shooting mode. Whether to switch the vertical / horizontal orientation for shooting according to the state of the own device according to the result determined by the fixed determination means at the time of shooting by the fixing determination means and the fixing determination means for determining whether to fix the corresponding vertical / horizontal orientation for shooting. It is characterized by including a switching control means for controlling the above.

According to the present invention, it is possible to provide a mechanism for appropriately fixing the vertical and horizontal directions to be photographed when photographing a subject that needs to be distinguished in the vertical and horizontal directions.

It is a system block diagram which shows an example of the system structure of the information processing system in embodiment of this invention. It is a hardware block diagram which shows an example of the hardware structure of the mobile terminal 100 in embodiment of this invention. It is a hardware block diagram which shows an example of the hardware structure of the server 200 in embodiment of this invention. It is a flowchart which shows an example of the rotation fixed control process by a shooting button in embodiment of this invention. It is a flowchart which shows an example of the rotation fixed control process by an icon operation in embodiment of this invention. It is a block diagram which shows the structure of the rotation fixed data table in embodiment of this invention. It is a screen example of the shooting screen and the shooting image confirmation screen of the A4 shooting size mode in the embodiment of the present invention. It is a screen example of the shooting screen and the shooting image confirmation screen of the A3 shooting size mode in the embodiment of the present invention. It is a block diagram which shows an example of the structure of the module of the mobile terminal 100 in the embodiment of this invention. It is a flowchart which shows an example of the rotation control processing in embodiment of this invention. This is a screen example of the shooting size mode selection menu in the embodiment of the present invention. This is an example of a screen for switching ON / OFF of fixed rotation in the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system configuration diagram showing an example of the configuration of the information processing system according to the embodiment of the present invention.

The information processing system according to the embodiment of the present invention is configured by connecting a mobile terminal 100 and a server 200 so as to be able to communicate with each other via a network 101 (for example, WAN = wide area network).

The mobile terminal 100 is an information processing device that captures a booklet (corresponding to an object to be imaged) with a camera, stores it, and transmits it to a server 200 via a network 101. Further, the mobile terminal 100 includes a touch panel 210.

The server 200 is a device that receives a plurality of images transmitted from the mobile terminal 100, converts them into one PDF file, and stores the images.

This is the end of the description of the system configuration diagram shown in FIG.

Hereinafter, the hardware configuration of the mobile terminal 100 shown in FIG. 1 will be described with reference to FIG.

The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

Further, the ROM 202 or the flash memory 214 will be described later, which is necessary for realizing a BIOS (Basic Input / Output System) which is a control program of the CPU 201, an operating system program (hereinafter, OS), and a function executed by the mobile terminal. Various programs to be executed are stored. The RAM 203 functions as a main memory, a work area, and the like of the CPU 201.

The CPU 201 realizes various operations by loading a program or the like necessary for executing a process into the RAM 203 and executing the program.

Further, the input controller 205 controls the input from the touch panel 210, the microphone 211, and the camera 212. The touch panel 210 controls the input related to the user's touch operation, the microphone 211 controls the input of voice, and the camera 212 controls the input of captured still images and moving images. The output controller 206 controls the output to the touch panel 210 and the speaker 213.

The touch panel 210 detects a touch operation from the user and displays an image sent from the output controller 206 described above. The touch panel 210 is a component in which a display and a position input device are integrated. Touch operations (hereinafter referred to as multi-touch) for a plurality of locations can also be detected.

The memory controller (MC) 207 controls access to the flash memory 214 that stores a boot program, browser software, various applications, font data, user files, edit files, various data, and the like. In the present embodiment, the flash memory will be described, but it may be a storage medium such as a hard disk (HD), a flexible disk (FD), or a card-type memory connected to a PCMCIA card slot via an adapter.

The communication I / F controller 209 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, Internet communication using TCP / IP is possible.

The sensor controller 208 controls the input from the sensor 215 included in the mobile terminal 100. There are various sensors in the sensor 215 of the mobile terminal 100, for example, a directional sensor and an acceleration sensor.

The CPU 201 can display the outline font on the touch panel 210 by executing the outline font expansion (rasterization) process on the display information area in the RAM 203, for example.

Various programs and the like used by the mobile terminal 100 of the present invention to execute various processes described later are recorded in the flash memory 214, and are executed by the CPU 201 by being loaded into the RAM 203 as needed. .. Further, the definition file and various information tables used by the program according to the present invention are stored in the flash memory 214.

This is the end of the description of the hardware configuration of the mobile terminal 100 shown in FIG. The above configuration is an example, and can be appropriately changed according to the purpose and application.

Hereinafter, the hardware configuration of the server 200 shown in FIG. 1 will be described with reference to FIG.

As shown in FIG. 3, the server 200 has a CPU (Central Processing Unit) 301, a RAM (Random Access Memory) 302, a ROM (Read Only Memory) 303, an input controller 305, a video controller 306, and a memory via the system bus 304. A configuration in which a controller 307, a communication I / F controller 308, and the like are connected is adopted.

The CPU 301 comprehensively controls each device and controller connected to the system bus 304.

Further, the ROM 302 or the external memory 311 will be described later, which is necessary for realizing the functions executed by the BIOS (Basic Input / Output System) and the OS (Operating System), which are the control programs of the CPU 301, and each server or each PC. Various programs etc. are stored. In addition, information necessary for carrying out the present invention is stored. The external memory may be a database.

The RAM 303 functions as a main memory, a work area, and the like of the CPU 301. The CPU 301 realizes various operations by loading a program or the like necessary for executing the process from the ROM 302 or the external memory 311 into the RAM 303 and executing the loaded program.

Further, the input controller 305 controls input from a pointing device such as a keyboard (KB) 309 or a mouse (not shown).

The video controller 306 controls the display on a display such as the display 310. The display may be a display such as a liquid crystal display. These are used by the administrator as needed.

The memory controller 307 is an external storage device (hard disk (HD)) for storing boot programs, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA (Personal Computer). Controls access to external memory 311 such as Compact Flash® memory connected to the Memory Card International Association card slot via an adapter.

The communication I / F controller 308 connects and communicates with an external device via the network, and executes communication control processing on the network. For example, communication using TCP / IP (Transmission Control Protocol / Internet Protocol) is possible.

The CPU 301 can be displayed on the display 310, for example, by executing the outline font expansion (rasterization) process in the display information area in the RAM 303. Further, the CPU 301 enables a user instruction by a mouse cursor (not shown) or the like on the display 310.

Various programs described later for realizing the present invention are recorded in the external memory 311 and executed by the CPU 301 by being loaded into the RAM 303 as needed.

This is the end of the description of the hardware configuration of the server 200 shown in FIG. The above configuration is an example, and can be appropriately changed according to the purpose and application.

Hereinafter, a block diagram showing an example of the configuration of the module of the mobile terminal 100 according to the embodiment of the present invention will be described with reference to FIG. 9.

The mobile terminal 100 includes a photographing unit 901, a storage unit 902, an operation detection unit 903, a screen adjustment unit 904, a rotation control unit 905, and a display unit 906, and an image storage application is installed.

The shooting unit 901 is a functional unit that controls shooting in order to generate and acquire a shot image by shooting a subject.

The storage unit 902 is a functional unit that controls to store a plurality of captured images and corrected images.

The operation detection unit 903 is a function unit that detects a touch operation or the like on the screen and controls to determine the type of the screen operation.

The screen adjustment unit 904 is a functional unit that controls the orientation of the shooting screen, the resolution of the camera, and the position for displaying the shooting guide area so as to be determined based on the determination result of the operation detection unit 903.

The rotation control unit 905 is a functional unit that controls the rotation of the screen based on the tilt and acceleration of the terminal and the determination result of the operation detection unit 903.

The display unit 906 is a functional unit that controls to display an image captured by the photographing unit 901. Before transmitting the image data to the server 200, the image can be confirmed on the display unit 906.

This is the end of the description of the block diagram showing an example of the module configuration of the mobile terminal 100 shown in FIG.

Hereinafter, the process executed by the mobile terminal 100 according to the embodiment of the present invention will be described with reference to the flowcharts shown in FIGS. 4, 5, and 10.

FIG. 4 is a flowchart showing an example of rotation fixed control processing by the photographing button by the mobile terminal 100.

In step S401, the mobile terminal 100 detects the touchdown operation of the shooting button.

In step S402, the mobile terminal 100 sets the value of the rotation fixing flag by the shooting button to true. That is, while the shooting button is pressed, the rotation of the shooting direction is fixed. The details of the rotation fixing flag by the shooting button will be described later in FIG.

In step S403, the mobile terminal 100 detects either a touch-up operation or a drag operation to the outside of the shooting button as an operation following the touchdown operation detected in step S401.

When the operation detected in step S403 is a drag operation to the outside of the shooting button, the mobile terminal 100 sets the value of the rotation fixing flag by the shooting button to false in step S404, and returns the process to step S401. That is, the rotation fixation in the shooting direction is released without any processing, and the state of waiting for shooting is returned.

When the operation detected in step S403 is a touch-up operation, in step S405, the mobile terminal 100 captures a subject and saves the image. The details of the rotation control process when the rotation of the terminal is detected in the shooting process will be described later in FIG.

In step S406, the mobile terminal 100 sets the value of the rotation fixing flag by the shooting button to false. That is, after shooting, the rotation fixation in the shooting direction is released. However, as a result of the rotation fixing control process by the shooting size switching icon operation in FIG. 5, when the value of the rotation fixing flag by the icon is set to true, the rotation fixing in the shooting direction is not released even after shooting. In order to avoid confusion of the user at this time, a message may be output on the screen to the effect that the rotation fixation is set.

This is the end of the description of the flowchart shown in FIG.

FIG. 5 is a flowchart showing an example of rotation fixed control processing by operating the shooting size switching icon by the mobile terminal 100. Details of the shooting size switching icon will be described later in FIGS. 7, 8 and 11.

In step S501, the mobile terminal 100 detects the operation of pressing the shooting size switching icon and displays the shooting size switching menu.

In step S502, the mobile terminal 100 detects the shooting size selection operation and displays the shooting screen having the screen configuration according to the selected shooting size.

In step S503, the mobile terminal 100 detects a long press operation of the shooting size switching icon. If it is detected, the process proceeds to step S504, and if it is not detected, this flow ends.

In step S504, the mobile terminal 100 determines the current value of the rotation fixing flag by the icon. The details of the rotation fixing flag by the icon will be described later in FIG.

If the value determined in step S504 is true, the rotation fixing is ON. Therefore, in step S505, the mobile terminal 100 sets the value of the rotation fixing flag by the icon to false and turns the rotation fixing OFF. That is, by operating the shooting size switching icon, the rotation fixing of the shooting direction is switched from the setting to the cancellation.

If the value determined in step S504 is false, the rotation fixing is OFF. Therefore, in step S506, the mobile terminal 100 sets the value of the rotation fixing flag by the icon to true and turns the rotation fixing ON. That is, by operating the shooting size switching icon, the rotation fixing of the shooting direction is switched from the release to the setting.

In the present embodiment, the shooting mode is switched by pressing the icon indicating the shooting mode, and the rotation is fixed by pressing and holding the icon. Each may be switched by another operation for the icon.

This is the end of the explanation of the flowchart shown in FIG.

FIG. 10 is a flowchart showing an example of rotation control processing of the photographing screen by the mobile terminal 100.

In step S1001, the mobile terminal 100 detects the rotation of the terminal.

In step S1002, the mobile terminal 100 determines the current value of the rotation fixed flag.

When it is determined in step S1002 that the rotation fixing flag by the shooting button is true or the rotation fixing flag by the icon is true, the rotation fixing is ON, so the rotation processing of the shooting screen is not performed.

If it is determined in step S1002 that the rotation fixing flag by the shooting button is false and the rotation fixing flag by the icon is false, the rotation fixing is OFF. Therefore, in step S1003, the mobile terminal 100 detects the horizontal position of the terminal.

When it is determined in step S1003 that the terminal is tilted from the horizontal position, in step S1004, the mobile terminal 100 rotates and displays the screen configuration of the shooting screen in the detected direction.

If it is determined in step S1003 that the terminal is in the horizontal state, the shooting screen is not rotated.

This is the end of the description of the flowchart shown in FIG.

Hereinafter, the data table shown in FIG. 6 will be described.

FIG. 6 is a data table showing an example of the data structure of the rotation fixed flag used in the processing of the flowcharts shown in FIGS. 4, 5, and 10. The rotation fixed flag holds a value indicating whether or not the screen can be rotated. If the value is true, the rotation is fixed ON, and the rotation cannot be performed. If the value is false, the rotation is fixed OFF, and the rotation is possible. In the rotation fixed state by pressing the shooting button, the rotation fixing flag is set on the rotation fixing table by the shooting button. In the rotation fixing state by pressing the shooting size switching icon, the rotation fixing flag is set in the rotation fixing table by the icon.

Hereinafter, the screen configuration diagrams shown in FIGS. 7, 8 and 10 will be described.

FIG. 7 is an example of a shooting screen and a shooting image confirmation screen in the A4 shooting size mode in which the shooting target is shot by the processing of the flowchart shown in FIG. The shooting screen 700 is composed of a shooting object 701, a shooting size switching icon 702, a shooting guide frame 703, a shooting button 704, and a shooting area 705. The shooting object 701 is the case of A4 paper, and the shooting guide frame 703 is displayed according to the shooting target in order to guide the photographed object to an appropriate shooting position. The captured image confirmation screen 710 is composed of a captured image 711, a save cancel button 713, and a save button 712. The captured image 711 corrects the captured image and extracts and displays only the region of the captured object.

Here, when a shooting object to be shot in the A4 shooting size mode (portrait shooting direction), for example, an A4 portrait size document, is shot in the other A3 shooting size mode (horizontal shooting direction), the shooting target The shooting direction does not match the object, and the correction process cannot be executed normally.

FIG. 8 is an example of a shooting screen and a shot image confirmation screen in the A3 shooting size mode in which the shooting target is shot by the processing of the flowchart shown in FIG. The shooting screen 800 is composed of a shooting object 801L / 801R, a shooting size switching icon 802, a shooting guide frame 803, a shooting button 804, a shooting area 805, and a shooting area center line 806. The shooting objects 801L and 801R are for A3 paper, and in order to guide them to an appropriate shooting position, the shooting guide frame 803 and the shooting area center line 806 are displayed according to the shooting target. The captured image confirmation screen 810 is composed of captured images 811L / 811R, a save cancel button 813, and a save button 812. The captured images 811L and 811R correct the captured images, extract only the region of the captured object, and display the captured images by dividing them into left and right.

Here, when a shooting object to be shot in the A3 shooting size mode (horizontal shooting direction), for example, an A3 horizontal size document, is shot in the other A4 shooting size mode (portrait shooting direction), the shooting target The shooting direction does not match the object, and the correction process cannot be executed normally.

FIG. 11 is an example of a shooting size mode selection menu for selecting a shooting size of the shooting screen by processing the flowchart shown in FIG. The menu 1100 is composed of the shooting size mode selection icon 1101 and indicates that the current shooting size mode is A4. When the shooting size mode selection icon 1101 is pressed, the menu 1110 is displayed and the shooting size mode is selected. The menu 1110 is composed of a standard mode icon 1111, an A4 mode icon 1112, an A3 mode icon 1113, and a shooting size mode selection icon 1114. Since the current shooting third mode is A4, the A4 mode icon 1112 is displayed in green, and the shooting size mode selection icon 1114 displays A4. When any of the standard mode icon 1111, the A4 mode icon 1112, and the A3 mode icon 1113 is pressed, the menu 1100 is displayed, the shooting size mode selection state ends, and the shooting size mode selected for the shooting size mode selection icon 1101 is displayed. It is displayed and the shooting screen is displayed with the screen configuration in the selected shooting size mode. When the shooting size mode selection icon 1114 is pressed, the menu 1100 is displayed and the shooting size mode selection state ends. Here, an example of selecting the shooting size mode in the menu 1110 is shown, but the shooting size mode may be switched by each time the shooting size mode selection icon 1101 is pressed without going through the menu 1110.

FIG. 12 is an example of an operation of switching ON / OFF of fixed rotation by processing the flowchart shown in FIG. The shooting size mode selection icon 1101 of the menu 1100 indicates that the current shooting size mode is A4, and further indicates that the rotation fixing is OFF because the display color of the icon is the same as the background color. When the shooting size mode selection icon 1101 is pressed and held, the display color of the shooting size mode selection icon is inverted like 1201, indicating that the rotation fixing is ON. When the shooting size mode selection icon is pressed and held again, the display color becomes the same as the background color like 1101 again, indicating that the rotation fixing is turned off. Here, the display color of the icon indicates the fixed rotation setting state, but any display method such as the shape of the icon or the display of marks other than the icon may be used. Further, in the process of the flowchart shown in FIG. 4, while the shooting button is touched down, the shooting size mode selection icon may be inverted to indicate that the rotation fixing is ON.

By making it possible to switch ON / OFF of the fixed rotation of the shooting direction in this way, it becomes possible to shoot the object to be shot in an appropriate shooting direction.

Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, an apparatus, a method, a program, a recording medium, or the like. Specifically, it may be applied to a system composed of a plurality of devices, or may be applied to a device composed of one device.

Further, the program in the present invention is a program in which a computer can execute the processing methods of the flowcharts shown in FIGS. 4, 5, and 10, and the storage medium of the present invention can execute the processing methods in FIGS. 4, 5, and 10. Program is remembered. ..

As described above, a recording medium on which a program for realizing the functions of the above-described embodiment is recorded is supplied to the system or device, and the computer (or CPU or MPU) of the system or device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disk or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. Needless to say, the present invention can also be applied when it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or device, the system or device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention. It should be noted that all the configurations in which the above-described embodiments and modifications thereof are combined are also included in the present invention.

100 mobile terminals 200 servers

Claims (6)

It is an information processing device equipped with a shooting means for shooting by switching the vertical and horizontal directions for shooting depending on the state of the own device.
Mode determination means for determining the shooting mode including the vertical and horizontal orientations for shooting,
A fixed determination means for determining whether to fix the vertical and horizontal orientations for shooting corresponding to the determined shooting mode, and
An information processing device including a switching control means for controlling whether to switch the vertical and horizontal directions of shooting according to the state of the own device according to the result determined by the fixed determination means at the time of shooting by the shooting means. The information processing device according to claim 1, wherein the fixing determination means fixes the vertical and horizontal directions of shooting according to an operation on a shooting button. A display control means for identifying and displaying the determined shooting mode is provided.
The information processing apparatus according to claim 1 or 2, wherein the fixing determination means determines whether to fix the vertical and horizontal directions of photographing according to an operation on a portion where the photographing mode is identified and displayed. The information processing device according to claim 3, wherein the display control means identifies and displays whether or not the vertical and horizontal orientations to be photographed are fixed. It is a control method of an information processing device provided with a shooting means for shooting by switching the vertical and horizontal directions for shooting depending on the state of the own device.
The mode determination means determines the shooting mode including the vertical and horizontal orientations for shooting, and the mode determination step.
A fixed determination step for determining whether the fixed determination means fixes the vertical and horizontal orientations for shooting corresponding to the determined shooting mode.
The switching control means is characterized by including a switching control step that controls whether to switch the vertical and horizontal directions of shooting according to the state of the own device according to the result determined in the fixed determination step at the time of shooting by the shooting means. Control method of the information processing device. It is a program that can be executed in an information processing device equipped with a shooting means for shooting by switching the vertical and horizontal directions for shooting according to the state of the own device.
The information processing device
Mode determination means for determining the shooting mode including the vertical and horizontal orientations for shooting,
A fixed determination means for determining whether to fix the vertical and horizontal orientations for shooting corresponding to the determined shooting mode, and
A program for functioning as a switching control means for controlling whether to switch the vertical and horizontal directions of shooting according to the state of the own device according to the result determined by the fixed determination means at the time of shooting by the shooting means.

Images