JP6409932B2 - Image processing program, image processing method, and information processing apparatus - Google Patents

Description

  The present application relates to an image processing program, an image processing method, and an information processing apparatus.

  There are systems that provide information such as data to one or more people using information communication terminals such as smartphones and tablet terminals. For example, in a class such as a school, there is a system that distributes a tablet terminal or the like for each student so that a teacher and the student can share and view a photograph, an image capture, a file, character information, and the like. In this way, by using the information communication terminal, not only can the work files, photographs, and digital textbooks distributed by the teacher be referenced, but also work such as extracting and saving a part can be performed. .

JP 2013-41332 A JP 2007-28536 A JP 2003-141105 A

  However, when a part of the distributed material is extracted and stored, the extracted portion is not necessarily limited to a certain area such as a newspaper article. Therefore, in order to extract a partial image, an operation technique for designating a desired region of the image is required, which is not a simple operation.

  In one aspect, an object of the present invention is to obtain a partial image obtained by extracting a desired region of an image with a simple operation.

The image processing program according to one aspect includes a case where a midway portion between a start point and an end point of the trajectory of a touch operation on a display image is located outside a rectangular region having the start point and the end point as a diagonal line In addition, the computer is caused to execute a process of specifying a rectangular area obtained by expanding the rectangular area as an extraction target so that at least the middle portion does not protrude .

  A partial image obtained by extracting a desired region of the image can be acquired with a simple operation.

It is a figure which shows an example of a function structure of the information processing apparatus in this embodiment. It is a figure which shows an example of the hardware constitutions of the information processing apparatus in this embodiment. It is a flowchart which shows an example of an image process. It is a figure for demonstrating the example of a screen at the time of mode setting. It is a figure which shows an example of the extraction object area | region in a 1st mode pattern. It is a figure which shows an example of the extraction object area | region in a 2nd mode pattern. It is a figure which shows an example of the extraction object area | region in a 3rd mode pattern. It is a figure which shows the example of a screen after the extraction object area | region is specified. It is a figure which shows an example of a capture screen. It is a figure which shows an example of a thumbnail image.

  Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

<Functional Configuration Example of Information Processing Device in Present Embodiment>
FIG. 1 is a diagram illustrating an example of a functional configuration of the information processing apparatus according to the present embodiment. In the example of FIG. 1, the information processing apparatus 10 includes a setting unit 11, a mode switching unit 12, a touch position acquisition unit 13, a region specifying unit 14, a display control unit 15, a display unit 16, and a storage unit 17. And a communication unit 18 and a control unit 19.

  The setting unit 11 sets a mode for extracting which portion of the image or character information to be displayed on the screen of the information processing apparatus 10. For example, after executing the image processing program in the present embodiment, the setting unit 11 presents a plurality of types of modes for extracting preset images on the screen using icons, menus, dialog boxes, and the like, and selects them for the user. By doing so, the mode may be set.

  As the mode setting, for example, a part of the image area desired by the user is extracted by touching the image displayed on the screen with a user's finger or a touch pen, etc. "Is set. In the present embodiment, a plurality of detailed modes can be set for the freehand mode.

  As a pattern of the detailed mode in the present embodiment, for example, there is a first mode pattern that selects a part traced by a touch operation (a part on the locus of the touch operation). In addition, as a pattern of the detailed mode, for example, an area surrounded by freehand, and in a traced area on the screen, when it is detected that the locus is a closed loop, an image portion ( There is a second mode pattern for selecting (closed loop region). Note that the closed loop region is a region in a trajectory obtained by, for example, a trajectory traced by a touch operation intersecting with another trajectory, but is not limited thereto.

  As a detailed mode pattern, for example, there is a third mode pattern in which the screen is an XY plane and the maximum region of the XY coordinate axes of the region traced freehand is extracted. Therefore, the region extracted by the third mode pattern is surrounded by four points, for example, the maximum (MAX) value and minimum (MIN) value for the X axis of the traced region and the maximum value and minimum value for the Y axis. This is a rectangular area. In other words, in the third mode pattern, the two horizontal lines passing through the two points farthest in the vertical direction of the screen of the display unit 16 and the two points farthest in the horizontal direction in the trajectory of the touch operation. A region surrounded by two vertical lines passing through each of the above is extracted.

  The detailed mode pattern is not limited to the first to third mode patterns described above, and may have other mode patterns. For example, the user may have a mode for selecting the entire screen by tapping the screen, a mode for selecting an image region by a swipe operation, and the like.

  The various settings by the setting unit 11 described above are preferably set in advance before the user or the like designates the image area. Information set by the setting unit 11 is stored in the storage unit 17 or the like.

  In order to extract a part of information (for example, an image) displayed on the screen of the display unit 16, the mode switching unit 12 switches a mode for designating a part of the area. The mode to be switched in the mode switching unit 12 is a mode set by the setting unit 11 described above.

  The touch position acquisition unit 13 acquires a touch operation position on the screen of the display unit 16 using a user's finger or a touch pen operated by the user. For example, the touch position acquisition unit 13 acquires a touch position (coordinates) on the screen with a touch pen or the like that performs a touch operation. In addition, the touch position acquisition unit 13 acquires continuous touch position coordinates corresponding to the trace traced by the touch operation.

  In addition, the touch position acquisition unit 13 acquires the coordinates of the position touched first and the position touched last. The first touched position is a coordinate value when the screen is touched with a finger or the like from a state where the screen is not touched, for example. The last touched position is, for example, a position touched after a predetermined time has elapsed from the time when the screen was first touched. Note that the last touched position is not limited to this. For example, the touched position may be a touch position after a predetermined time has elapsed since the trajectory of the moving touch stops, and the user traces the screen. The position when the finger or the like is separated from the screen may be used, but is not limited to this.

  In addition, when a cursor or the like is displayed on the screen of the display unit 16 by an input through an input interface such as a mouse, the touch position acquisition unit 13 acquires a position associated with the cursor. Further, the touch position acquisition unit 13 may acquire a touch position corresponding to an operation such as a tap or a double tap, and may include a plurality of pieces of movement information of the touch position such as flicks and swipes, and pinch-in and pinch-out. The operation content using the finger or the like can be acquired.

  The region specifying unit 14 specifies an image extraction target region based on the type of extraction mode by the setting unit 11 and the touch operation locus obtained by the touch position acquisition unit 13. Further, the area specifying unit 14 extracts image data (partial image) corresponding to the specified image extraction target area. The area specifying unit 14 stores (saves) the extracted image data in the storage unit 17.

  For example, the region specifying unit 14 specifies a portion on the locus of the touch operation in the displayed image as an image extraction target region. For example, when detecting that the locus of the touch operation forms a closed loop, the area specifying unit 14 may extract the detected closed loop area as an image extraction target area.

  In addition, the area specifying unit 14 includes, for example, two horizontal lines that pass through two points that are the farthest in the vertical direction of the screen of the display unit 16 and two points that are the farthest in the horizontal direction. You may specify the area | region enclosed by the two vertical lines which pass through each as an extraction object area | region.

  In addition, the area specifying unit 14 is, for example, when the middle part between the start point and the end point of the trace of the touch operation that is continuously traced is located outside the rectangular area having the start point and the end point as diagonal lines. You may specify the rectangular area which extended the rectangular area so that at least the above-mentioned middle part may not protrude as an extraction object area. In this case, the expanded rectangular area is, for example, a rectangle having the minimum area surrounding the trajectory, but is not limited to this, and may have other shapes.

  The display control unit 15 receives an instruction to execute processing for extracting an image in the present embodiment, and displays a screen, icons, menus, dialog boxes, and the like for allowing the setting unit 11 to set a mode. .

  Further, the display control unit 15 displays the position information (touch position) of the traced part acquired by the touch position acquisition unit 13 on the screen. Further, the display control unit 15 displays an image showing the extraction target portion specified by the region specifying unit 14. The display control unit 15 may display a portion on the locus of the touch operation so as to be distinguishable from a portion other than the locus of the touch operation in order to present to the user which part of the image to be extracted is a part. Good. In this case, the display control unit 15 may make it possible to distinguish a portion on the locus of the touch operation from a portion other than the portion on the locus of the touch operation by changing the color. The color to be changed can be set in advance by the setting unit 11, but any color can be used.

  Further, the display method of the specified region is not limited to this, and for example, the region may be identified by performing oblique lines, a pattern, blinking of the region, or the like. Further, the display control unit 15 may generate and display a captured image or a thumbnail image of the extracted image region (partial image).

  The display unit 16 is a distribution material stored in the storage unit 17, data such as various images and videos, an external device (for example, another information processing device, a server, one or more information processing devices) via the communication unit 18 or the like. Data distributed from a cloud server comprised of, etc.). Further, the display unit 16 displays the partial image extracted by each mode in the present embodiment. The touch position acquisition unit 13 and the display unit 16 described above may be configured as, for example, an integrated touch panel display. In this case, the touch position acquisition unit 13 acquires the position (coordinates) where the display unit 16 is touched.

  The storage unit 17 stores various data used at the time of image processing in the present embodiment. For example, the storage unit 17 stores mode setting information according to the present embodiment, setting information regarding display contents, information before extraction (for example, an entire image), information after extraction (for example, a partial image), and the like. However, the present invention is not limited to this. The storage unit 17 may store log information (history information) indicating processing results, error information, communication setting information for transmitting / receiving data to / from an external device, and the like.

  The communication unit 18 transmits / receives data to / from an external device via a communication network represented by the Internet, a Local Area Network (LAN), and the like. Note that the communication network may be wired or wireless, or a combination thereof.

  The control unit 19 controls the entire components for performing image processing in the present embodiment. Control by the control unit 19 includes, for example, setting by the setting unit 11, mode setting at the time of partial image extraction by the mode switching unit 12, acquisition of a touch position by the touch position acquisition unit 13, and an image extraction target region ( (Cutout area) is specified, display control by the display control unit 15, display by the display unit 16, and the like are performed. The content of control by the control unit 19 is not limited to this, and for example, a distribution information material request process, various information download / upload processes, an error process when an abnormality occurs, and the like can be performed.

  The information processing apparatus 10 illustrated in the example of FIG. 1 is an information communication terminal such as a smartphone, a tablet terminal, or a personal digital assistant (PDA). Further, the information processing apparatus 10 may be an electronic boat (electronic blackboard or the like), a general-purpose personal computer (PC), a game machine, a music playback device, or the like.

<Hardware Configuration Example of Information Processing Apparatus 10>
FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the present embodiment. In the example of FIG. 2, the information processing apparatus 10 includes a microphone (hereinafter referred to as a microphone) 21, a speaker 22, a display unit 23, an operation unit 24, a sensor unit 25, a power unit 26, and a wireless unit 27. The short-range communication unit 28, the auxiliary storage device 29, the main storage device 30, the central processing unit (CPU) 31, and the drive device 32 are connected to each other via a system bus B.

  The microphone 21 inputs a voice uttered by the user and other sounds. The speaker 22 outputs the other party's voice or sounds such as a ringtone. The microphone 21 and the speaker 22 are used, for example, when talking to a call partner using a call function or the like.

  The display unit 23 is a display such as a Liquid Crystal Display (LCD) or an organic Electro Luminescence (EL). The display unit 23 may be a touch panel display having a display and a touch panel, for example. The display unit 23 corresponds to an example of the display unit 16 described above, for example.

  The operation unit 24 is an operation button, a touch panel, or the like. The operation buttons are, for example, a power button, a volume adjustment button, and other operation buttons. The touch panel is configured as a touch panel display in which a display (display unit 23) and a touch panel are superimposed, for example. As the touch panel, for example, a resistive film method, a capacitance method, an optical method, an electromagnetic induction method, or the like can be used. Any method can be used as long as the touch panel has a sampling rate and resolution sufficient to allow touch input to the software keyboard. The operation unit 24 corresponds to an example of the touch position acquisition unit 13 described above, for example.

  The sensor unit 25 detects a certain point in time or continuous operation of the information processing apparatus 10. For example, the sensor unit 25 detects the tilt angle, acceleration, direction, position, and the like of the information processing apparatus 10 itself, but is not limited thereto. The sensor unit 25 includes, for example, an analog output acceleration sensor. However, the sensor unit 25 is not limited thereto. For example, the sensor unit 25 may include an inclination sensor, a gyro sensor, a global positioning system (GPS), or the like.

  The power unit 26 supplies power to each component of the information processing apparatus 10. The power unit 26 is, for example, an internal power source such as a battery, but is not limited thereto. The power unit 26 can also detect the amount of power constantly or at predetermined time intervals and monitor the remaining amount of power.

  The radio unit 27 is a communication data transmission / reception unit that receives a radio signal (communication data) from a base station using, for example, an antenna or transmits a radio signal to the base station via an antenna.

  The short-range communication unit 28 performs short-range communication with other information processing apparatuses and external devices using communication methods such as infrared communication, Bluetooth (registered trademark), and Wi-Fi (registered trademark). The wireless unit 27 and the short-range communication unit 28 described above are communication interfaces that enable data transmission / reception with an external device or the like.

  The auxiliary storage device 29 is a storage unit such as a hard disk drive (HDD) or a solid state drive (SSD). The auxiliary storage device 29 stores various programs and the like and inputs / outputs data as necessary.

  The main storage device 30 stores an execution program read from the auxiliary storage device 29 in response to an instruction from the CPU 31, and stores various information obtained during program execution. The main storage device 30 is, for example, a read only memory (ROM) or a random access memory (RAM), but is not limited thereto. The auxiliary storage device 29 and the main storage device 30 correspond to an example of the storage unit 17 described above, for example.

  The CPU 31 controls processing of the entire computer, such as various operations and data input / output with each hardware component, based on a control program such as an operating system and an execution program stored in the main storage device 30. Thus, each process in the image processing is realized.

  Specifically, the CPU 31 executes a program on the main storage device 30 by causing the auxiliary storage device 29 to execute a program based on, for example, a program execution instruction obtained from the display unit 23, the operation unit 24, or the like. Process corresponding to. For example, by executing the image processing program, the CPU 31 sets the mode by the setting unit 11 described above, mode switching at the time of partial image extraction by the mode switching unit 12, acquisition of the touch position by the touch position acquisition unit 13, and area specification Processing such as specifying an image extraction target region by the unit 14 is performed. Further, the CPU 31 executes an image processing program to perform processing such as display control by the display control unit 15, display by the display unit 16, reading and writing of data by the storage unit 17, and transmission and reception of data by the communication unit 18. . The processing contents in the CPU 31 are not limited to the contents described above. The contents executed by the CPU 31 are stored in the auxiliary storage device 29 or the like as necessary.

  For example, the drive device 32 can detachably set the recording medium 33 and the like, and can read various information recorded on the set recording medium 33 and write predetermined information on the recording medium 33. The drive device 32 is, for example, a medium loading slot or the like, but is not limited thereto.

  The recording medium 33 is a computer-readable recording medium that stores an execution program and the like as described above. The recording medium 33 may be a semiconductor memory such as a flash memory, for example. Further, the recording medium 33 may be a portable recording medium such as a Universal Serial Bus (USB) memory, but is not limited thereto.

  In this embodiment, by installing an execution program (for example, an image processing program or the like) in the hardware configuration of the computer main body described above, hardware processing and software cooperate to realize image processing or the like in this embodiment. can do. Further, the image processing program corresponding to the above-described image processing may be in a resident state on the apparatus, for example, or may be activated by an activation instruction.

  As one aspect, the information processing apparatus 10 described above is mounted using, for example, a device on which a display device-integrated touch panel display is mounted and software that operates on the device. The software part may be realized by hardware that performs an equivalent function. Further, the information processing apparatus 10 may be realized by a hardware configuration such as a PC.

<Example of image processing>
Next, an example of image processing in the information processing apparatus 10 will be described using a flowchart. FIG. 3 is a flowchart illustrating an example of image processing. In the image processing shown in the example of FIG. 3, it is assumed that various settings such as a mode by the setting unit 11 are made in advance before the processing is executed. In the example of FIG. 3, the first to third mode patterns described above are set as the freehand partial image extraction mode according to the present embodiment. However, the present invention is not limited to this. Absent.

  In the example of FIG. 3, the setting unit 11 of the information processing apparatus 10 selects a mode (for example, a freehand mode) for extracting and storing a part of the displayed image according to an instruction from the user or the like. Acceptance (S01) and further selection of the detailed mode is accepted (S02). In the processes of S01 and S02, the mode switching unit 12 can accept the mode selected by the user with respect to icons, menus, dialog boxes, and the like displayed on the screen of the display unit 16. However, the present invention is not limited to this. Is not to be done.

  Next, the mode switching unit 12 of the information processing apparatus 10 switches to the mode accepted in the process of S02 (S03). Next, the touch position acquisition unit 13 of the information processing apparatus 10 determines whether the mode selected by the user is the first mode pattern described above (S04). If the touch position acquisition unit 13 is the first mode pattern (YES in S04), the touch position acquisition unit 13 of the information processing apparatus 10 receives a touch start (start point) (S05) and is traced. Is acquired (S06). In the process of S06, the display control unit 15 displays the trajectory information corresponding to the position of the part traced with the finger or the like on the display unit 16 so that the user can know which part is traced on the screen. Also good. The touch position acquisition unit 13 may temporarily store the position information acquired in the process of S06 in an internal memory or the like.

  Next, the information processing apparatus 10 determines whether or not the finger touching the screen of the display unit 16 has left the screen (S07). In the process of S07, it is determined whether or not the user's finger is recognized as an end point when the finger is removed. In the process of S07, for example, a determination may be made based on whether or not a touch position after a predetermined time has elapsed since the start point was received. In the process of S07, it is determined whether or not the finger is removed at every predetermined interval.

  If the finger is not removed in the process of S07 (NO in S07), the process returns to S06. That is, information on the touched position (position on the trajectory) is stored until it is determined that the finger has been released. When the finger is released in the process of S07 (YES in S07), the area specifying unit 14 of the information processing apparatus 10 specifies the locus from the start point to the end point described above and the area in the first mode pattern. Based on the conditions, the extraction target area is specified (S08). In the first mode pattern, the part on the locus of the touch operation is specified as the image extraction target area.

  In addition, when it is not the first mode pattern in the process of S04 (NO in S04), the touch position acquisition unit 13 determines whether or not it is the second mode pattern described above (S09). If it is the second mode pattern (YES in S09), the touch position acquisition unit 13 receives a touch start (start point) (S10) and acquires position information of the traced part (S11). In the process of S11, the trajectory information may be displayed on the display unit 16 as described above. The acquired position information is temporarily stored in an internal memory or the like.

  Next, the region specifying unit 14 determines whether or not the traced trajectory has become a closed loop (S12). If the trajectory is not a closed loop (NO in S12), the process returns to S11. That is, processing is continued until a closed loop is reached. If it is a closed loop (YES in S12), the area specifying unit 14 selects the inside of the closed loop as an extraction area (S13).

  Next, the touch position acquisition unit 13 determines whether or not the user's finger has left the screen of the display unit 16 (S14). If the user's finger has not been released (NO in S14), the process of S11 is performed. Return. When the user's finger is released (YES in S14), the extraction target region is specified based on the position coordinates of the start point and the end point and the region specifying condition in the second mode pattern (S15). In the second mode pattern, when it is detected that the trace of the touch operation continuously traced forms a closed loop, an image portion surrounded by the closed loop is specified as an image extraction target.

  In addition, when the touch position acquisition unit 13 is not the second mode pattern in the process of S09 (NO in S09), the touch position acquisition unit 13 performs the process as the above-described third mode pattern.

  The touch position acquisition unit 13 receives a touch start (start point) by a user's finger or the like (S16), and acquires position information of the traced part (S17). In the process of S17, the trajectory information may be displayed on the display unit 16 as described above. The acquired position information is temporarily stored in an internal memory or the like.

  Next, the touch position acquisition unit 13 determines whether or not the finger has been released (end point) (S18). If the finger has not been released (NO in S18), the process returns to S17. When the finger is released (YES in S17), the touch position acquisition unit 13 acquires the maximum and minimum values of the X axis and the maximum and minimum values of the Y axis among the traced portions (S19). The extraction target area is specified based on the information obtained in the process of S19 and the area specifying condition in the third mode pattern (S20). In the third mode pattern, for example, two horizontal lines passing through two points (for example, the maximum value and the minimum value of the Y axis) that are farthest in the vertical direction from the locus of the touch operation, and the furthest distance in the horizontal direction A region surrounded by two vertical lines passing through each of the two points (for example, the maximum value and the minimum value of the X axis) is specified as the extraction target region.

  In addition, as the third mode pattern, for example, when the middle part between the start point and the end point of the touch operation locus is located outside the rectangular area having the start point and the end point as diagonal lines, at least the middle part protrudes. Alternatively, a rectangular area that is an expanded rectangular area may be specified as the extraction target area.

  Next, the display control unit 15 of the information processing apparatus 10 displays a save button for saving the extraction target area specified by the process of S08, S15, or S20 on the display unit 16 (S21), and the user saves it. It is determined whether or not the button has been pressed (S22). In the process of S21 described above, a cancel button or the like may be displayed together with the save button. In the process of S21, it may be determined whether or not the button is selected within a predetermined time (for example, 3 to 5 seconds) after the button is displayed. In the process of S22 described above, for example, it can be determined whether or not the touch position designated by the user is within the area of the displayed save button, but is not limited thereto.

  In the process of S22, when the save button displayed on the screen has not been pressed for a predetermined time or longer (NO in S22), the control unit 19 of the information processing apparatus 10 deletes the save button from the screen and specifies the extraction target specified. The area is released and the process returns to S01. If the save button has not been pressed for a predetermined time or more, the image processing may be terminated without returning to the processing of S01. The control unit 19 may perform the same processing as when the save button is not pressed within a predetermined period even when the cancel button or the like displayed on the screen is pressed.

  If the save button is pressed in the process of S22 (YES in S22), the display control unit 15 displays a screen capture save confirmation screen (S23), and prompts the user for confirmation. Here, the control unit 19 determines whether or not the user has pressed the save button (S24). If the user has not pressed the save button (NO in S24), the process returns to the process of S01. Note that the processing may be terminated when the cancel button is pressed.

  If control unit 19 accepts that the save button has been pressed (YES in S24), image is stored in storage unit 17 (S25), and the process ends. Note that the storage processing described above may be performed by the region specifying unit 14. In the above-described processing, processing is performed using the first to third mode patterns. However, the type and order of the mode patterns and the number of mode patterns are not limited to this. For example, as a mode other than the freehand mode, there may be a mode for selecting the entire screen by tapping the screen or a mode for selecting an area to be extracted by a swipe operation. In the present embodiment, the extraction target region is specified based on a preset mode pattern.

  In the present embodiment, for example, when the save button is displayed in the above-described processing of S21, a detailed mode selection screen is displayed, and when the user switches the mode, the screen corresponding to the switching is displayed. Then, the user may confirm whether or not to save. In this case, it is preferable to execute processing until the extraction target region is specified in parallel for all modes. As a result, it is possible to immediately identify the corresponding area in accordance with the user's mode switching.

<Screen example>
Next, examples of various screens for performing image processing in the present embodiment will be described with reference to the drawings. FIG. 4 is a diagram for explaining an example of a screen at the time of mode setting. In the example of FIG. 4, the information processing apparatus 10 such as a touch panel display is used, but the present invention is not limited to this. Further, in the example of FIG. 4, elementary school materials distributed from an external device (server) connected via a communication network or the like are displayed, but the extraction target image is limited to this. It is not a thing.

  For example, in the present embodiment, as shown in FIG. 4A, a partial image (partial image) of the basic image 40 is extracted from the basic image 40 displayed on the screen of the display unit 16 by the operation in the present embodiment. Perform the process. In this case, a menu bar 41 capable of selecting a plurality of processing contents is displayed, and an icon (for example, icon 41a) for capturing (temporarily saving) a part of the display screen is selected from the menu bar 41 in advance. Accept. Thereby, as shown in FIG. 4B, a setting input screen 42 for extracting a part of the image is performed. For example, on the screen of FIG. 4B, various buttons 43 for setting a mode for designating the extraction range are displayed.

  For example, the “go to menu” button 43-1 is a button for canceling the screen mode shown in FIG. 4B and returning to the screen on which the basic image 40 shown in FIG. 4A is displayed. The “free hand” button 43-2 is a button for selecting a mode for extracting and storing a part of an image in the present embodiment. The “tap / swipe” button 43-3 is a button for selecting a mode for saving the entire screen or the like by a tap or swipe operation.

  In the present embodiment, when the selection of the freehand button 43-2 is accepted, the detailed mode is displayed on the pop-up screen 44. In the detailed mode, the three modes described above (the traced area (first mode pattern), the enclosed area (second mode pattern), and the minimum / maximum area (third mode pattern)) are displayed. . When the user selects one of the above-described detailed modes, the information processing apparatus 10 specifies the extraction target region in accordance with the mode.

<Regarding the extraction target area in each mode pattern>
Next, extraction target areas in the above-described first to third mode patterns will be described with reference to the drawings.

<Example of Extraction Target Area in First Mode Pattern>
FIG. 5 is a diagram illustrating an example of an extraction target area in the first mode pattern. The first mode pattern shown in the example of FIG. 5 selects only a portion (traced portion) on the locus by the touch operation. Note that the portion on the locus by the touch operation is a portion on the locus by the so-called one-stroke writing in which the touch operation is continuously performed on the screen, for example.

  For example, when the user's finger 51 touches the screen, and there is a touch operation locus indicated by a dotted line in FIG. 5, the portion 52 on the locus of the touch position is specified as the extraction target region. In the first mode pattern, an area having a preset width W (for example, about 1 to 5 cm) with respect to the locus of the touch position is selected. This width may be set corresponding to the thickness of the finger in contact with the screen (the size of the contact surface). Further, when the screen is traced with a touch pen or the like, a thin line is formed, and therefore, a predetermined width (thickness) may be given around the line.

  As described above, in the first mode pattern, a portion of the display image on the locus of the touch operation is specified as an image extraction target region in the touch operation locus, and image data of the specified image extraction target region is extracted. The In other words, in the first mode pattern, the image extraction target area is specified by painting the traced part (the part on the trajectory).

<Example of Extraction Target Area in Second Mode Pattern>
Next, an example of the extraction target area in the second mode pattern will be described with reference to the drawings. FIG. 6 is a diagram illustrating an example of an extraction target area in the second mode pattern. 6A to 6C show an example of selecting each region. In the second mode pattern, when a closed loop is detected in the region 53 traced by the user's finger 51, an image of a portion surrounded by the closed loop is specified as the extraction target region.

  For example, in the second mode pattern, when a point from a start point to an end point (traced region 53) is set at a predetermined time interval or a finger movement amount exceeds a predetermined value, Plot the position (coordinates). Further, in the second mode pattern, when the trajectory of the finger on the screen intersects with another trajectory that has been traced up to that point, the region (closed loop region) surrounded by the trajectory is the extraction target region. .

  In the example of FIG. 6A, the start point and the end point are at the same position. Therefore, the closed loop region 54-1 surrounded by the trajectory (traced region 53) from the start point to the end point is specified as the extraction target region. Also, in the example of FIG. 6B, since the start point and the end point intersect, an area (closed loop area) surrounded by the locus is specified as the extraction target area. In the example of FIG. 6B, since the trajectories once intersect except for the start point and the end point, two closed loop regions 54-2 and 54-3 exist. In this case, the region specifying unit 14 may specify both the closed loop regions 54-2 and 54-3 as extraction target regions, and the first closed loop region 54-2 or the last closed loop region 54-3. May be specified as the extraction target region.

  In FIG. 6C, since there is one intersection point in the locus of the touch operation from the start point to the end point (traced region 53), the closed loop region 54-4 of only that portion is identified. This is the target area.

  In the second mode pattern, when the trajectories intersect, the region surrounded by the trajectories (closed loop region) is selected, but the present invention is not limited to this, and the trajectories are within a predetermined distance (for example, Even if it is less than about 1 cm), the extraction target region may be specified as a closed loop region. In this case, a closed loop region can be formed by connecting two points on the locus where the locus is closest to each other with a straight line or the like, but the present invention is not limited to this.

<Example of Extraction Target Area in Third Mode Pattern>
Next, an example of the extraction target area in the third mode pattern will be described with reference to the drawings. FIG. 7 is a diagram illustrating an example of an extraction target area in the third mode pattern. In the third mode pattern, in the touch operation by the user's finger 51, the extraction target region is specified using a rectangular region obtained from the locus of the finger 51 (the traced region 53).

  For example, as a third mode pattern, two horizontal lines passing through each of two points farthest in the vertical direction (Y direction) and two farthest in the horizontal direction (X direction) of the locus of the touch operation An area surrounded by two vertical lines passing through each point is specified as an extraction target area.

  For example, in the example of FIG. 7A, in the coordinate system (XY coordinate system) based on the XY axes set on the screen, the X axis of the trajectory (traced region 53) of the finger 51 by the user's touch operation. The maximum value and the minimum value of the coordinates (X coordinate) with respect to are the two points farthest apart in the horizontal direction. In addition, the maximum value and the minimum value of the coordinates (Y coordinate) with respect to the Y axis are the two points that are farthest in the vertical direction. Accordingly, as shown in FIG. 7A, two horizontal lines a and b passing through the maximum value (Y axis MAX) and the minimum value (Y axis MIN) of the Y coordinate, and the maximum value of the X coordinate (X axis MAX). A region 55-1 surrounded by two vertical lines c and d passing through the minimum value (X axis MIN) is specified as the extraction target region. In the example of FIG. 7A, since the four points of the maximum and minimum of the X coordinate and the maximum and minimum of the Y coordinate are determined, a rectangular region in contact with these four points may be specified as the extraction target region. .

  When the third mode pattern is selected, even if the locus of the touch operation is the same as that in FIG. 6C described above, the region specifying condition similar to that in FIG. ), A different area 55-2 can be specified as the extraction target area.

  For example, in the third mode pattern, as shown in FIG. 7C, the middle part between the start point and end point of the locus of the touch operation (traced region 53) is a diagonal line between the start point and end point. When it is located outside the rectangular area 56, an area 55-3 that is an extension of the rectangular area 56 so as not to protrude at least partway is detected as an extraction target area. The expanded rectangular area is a rectangle having the minimum area surrounding the trajectory described above, but is not limited to this and may have a preset shape. In the example of FIGS. 7A and 7C, as a result, extraction target regions having the same size are designated. Note that the mode pattern in FIG. 7C may be set as a mode pattern (fourth mode pattern) different from that in FIGS.

  The area selected by each mode pattern described above is displayed on the screen, and then an image (partial image) in the area is extracted according to a user instruction (for example, a save instruction) or the like and stored in the storage unit 17 or the like. Saved.

  In the present embodiment, the area selected by the touch operation described above is enlarged by, for example, performing an operation such as pinch-in or pinch-out (an action of releasing or bringing two fingers apart), Reduction or the like may be performed.

<Screen example after the extraction target area is specified>
FIG. 8 is a diagram illustrating an example of a screen after the extraction target area is specified. The example of FIG. 8 shows an example of the screen after the image extraction target area is specified by the above-described third mode pattern. In the example of FIG. 8, the display control unit 15 causes the screen 60 to extract an extraction target area (part on the touch operation trace (traced area 53)) 61 on the screen 60 and a non-extraction target area (other than on the touch operation trace). ) 62 is displayed in an identifiable manner. Thereby, the user can easily grasp the specified extraction target region (cutout portion). Note that the display control unit 15 can identify the extraction target area 61 and the non-extraction target area 62 by changing the color or the like, for example, with respect to the screen 60. However, the present invention is not limited to this. For example, the display control unit 15 may make it possible to identify the extraction target area 61 and the non-extraction target area 62 by diagonal lines, patterns, blinking areas, and the like. When the user confirms such a screen 60 and selects a save button 63 (“Save Selected Area” in the example of FIG. 8) displayed on the screen 60, the display control unit 15 causes the extraction within the extraction target area. The image (partial image) is captured and the captured screen is displayed on the display unit 16.

  In the present embodiment, a mode pattern switching button is displayed on the screen 60 shown in FIG. 8, and the mode corresponding to the switched mode pattern can be displayed by switching the mode.

<Example of capture screen>
FIG. 9 is a diagram illustrating an example of a capture screen. The capture screen 70 shown in FIG. 9 has an identified extraction target area 71, a save button 72 for finally deciding to save, and a cancel button 73 for canceling the save. The extraction target area 71 illustrated in the example of FIG. 9 corresponds to the area illustrated in FIG.

  As shown in FIG. 9, by having the capture screen 70, the user can easily grasp the extraction target area of the image specified by each mode, and by selecting the save button 72 or the cancel button 73. Then, it is determined whether or not to finally save, and only a desired image can be saved. In the present embodiment, for example, the partial image of the corresponding region may be stored in the storage unit 17 after the save button shown in FIG.

<Example of thumbnail image>
FIG. 10 is a diagram illustrating an example of a thumbnail image. When the user selects the save button 72 on the capture screen 70 illustrated in the example of FIG. 9, the partial image corresponding to the extraction target area 71 is stored in the storage unit 17. At this time, it is stored in a preset folder or the like. The display control unit 15 can display the partial images stored in the folder as thumbnail images 81 on the screen 80 shown in FIG. A plurality of partial images can be confirmed simultaneously by thumbnail display.

  In the example of FIG. 10, since a part of the material (image) used in the arithmetic class is extracted, the thumbnail image 81 is stored in the folder in which the arithmetic data is stored. As shown in the example of FIG. 10, the thumbnail image 81 can also display detailed information such as a file name, a creator name, an image creation date and time, but is not limited thereto.

  Each of the embodiments described above may be combined in part or in whole. For example, when the first mode pattern and the second mode pattern described above are combined to extract a portion on the locus of the touch operation as an extraction target region and the locus of the touch operation is formed in a closed loop, A closed loop region may also be extracted as an extraction target region. In this case, for example, even if the locus (traced area) is the same as that in FIGS. 6C and 7B, an extraction target area different from that in FIGS. 6C and 7B is selected. Can be extracted.

  According to one aspect of the above-described embodiment, it is possible to acquire a partial image obtained by extracting a desired region of an image with a simple operation. Note that the image processing method in the present embodiment can be widely applied to various fields. An example of this is application to Information and Communication Technology (ICT, Information Communication Technology) utilization classes. By applying the image processing method in this embodiment to the ICT utilization class, for example, you can extract a part of the worksheet presented by the teacher, extract only the part of the fish in it from the aquarium photo, digital textbook A part of the screen can be captured and extracted and saved. Since this embodiment can realize extraction of a part of an image with a simple operation, it can be applied to a wide generation including not only elementary school students and junior high school students but also elderly people.

  In addition, anyone can easily use ICT classes, and records of lessons and learning are accumulated, so that the accumulated data can be used effectively. In addition, visualization of classes and learning history of students can be analyzed. Therefore, the quality of education by using data can be improved. Also, by providing a learning environment that does not stop at the school, it is possible to realize continuity of learning with the home by sharing information with parents, visualizing home learning, and recommending optimal teaching materials and learning methods. it can. The information processing apparatus 10 described above can be used not only for the school education described above, but also for companies, individuals, etc. as a tool for providing information.

  Each embodiment has been described in detail above. However, the present invention is not limited to the specific embodiment, and various modifications and changes other than the above-described modification are possible within the scope described in the claims. .

In addition, the following additional remarks are disclosed regarding the above Example.
(Appendix 1)
Specify the part of the display image on the locus of the touch operation as the extraction target area,
Extracting the image data of the identified extraction target area and storing it in a storage unit;
An image processing program that causes a computer to execute processing.
(Appendix 2)
The image processing program according to claim 1, wherein the part on the locus of the touch operation is a part on the locus on which the touch operation is continuously performed.
(Appendix 3)
The image processing program according to appendix 1 or 2, wherein a portion on the locus of the touch operation is displayed so as to be distinguishable from a portion other than the portion on the locus of the touch operation.
(Appendix 4)
The image processing program according to appendix 3, wherein when the display is performed so as to be identifiable, a portion on the locus of the touch operation can be distinguished from a portion other than the portion on the locus of the touch operation by changing a color. .
(Appendix 5)
The image processing program according to any one of appendices 1 to 4, wherein when the touch operation locus forms a closed loop, an area surrounded by the closed loop is specified as the extraction target area.
(Appendix 6)
A region surrounded by two horizontal lines passing through each of the two points furthest away in the vertical direction and two vertical lines passing through each of the two points furthest away in the horizontal direction in the locus of the touch operation on the display image Identify the region to be extracted,
An image processing program that causes a computer to execute processing.
(Appendix 7)
The two points farthest in the vertical direction are the maximum and minimum values of the Y coordinate in the XY coordinate system set on the screen, and the two points farthest in the horizontal direction are the X and Y values in the XY coordinate system. The image processing program according to attachment 6, wherein the image processing program has a maximum value and a minimum value of coordinates.
(Appendix 8)
Of the trajectory of the touch operation on the display image, when the midway portion between the start point and end point of the trajectory is located outside the rectangular area having the start point and end point as a diagonal line, at least the midway portion protrudes. Specify a rectangular area that is an extension of the rectangular area as an extraction target,
An image processing program that causes a computer to execute processing.
(Appendix 9)
The image processing program according to appendix 8, wherein the expanded rectangular area is a quadrangle having a minimum area surrounding the locus.
(Appendix 10)
Information processing device
Specify the part of the display image on the locus of the touch operation as the extraction target area,
Extracting the image data of the identified extraction target area and storing it in a storage unit;
An image processing method.
(Appendix 11)
Information processing device
A region surrounded by two horizontal lines passing through each of the two points furthest away in the vertical direction and two vertical lines passing through each of the two points furthest away in the horizontal direction in the locus of the touch operation on the display image Identify the region to be extracted,
An image processing method.
(Appendix 12)
Information processing device
Of the trajectory of the touch operation on the display image, when the midway portion between the start point and end point of the trajectory is located outside the rectangular area having the start point and end point as a diagonal line, at least the midway portion protrudes. Specify a rectangular area that is an extension of the rectangular area as an extraction target,
An image processing method.
(Appendix 13)
An information processing apparatus comprising: an area specifying unit that specifies a part of a display image on a locus of a touch operation as an extraction target area, extracts image data of the specified extraction target area, and stores the extracted image data in a storage unit .
(Appendix 14)
A region surrounded by two horizontal lines passing through each of the two points furthest away in the vertical direction and two vertical lines passing through each of the two points furthest away in the horizontal direction in the locus of the touch operation on the display image An information processing apparatus comprising: an area specifying unit that specifies an extraction target area.
(Appendix 15)
Of the trajectory of the touch operation on the display image, when the midway portion between the start point and end point of the trajectory is located outside the rectangular area having the start point and end point as a diagonal line, at least the midway portion protrudes. An information processing apparatus comprising: an area specifying unit that specifies a rectangular area obtained by expanding the rectangular area as an extraction target.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 11 Setting part 12 Mode switching part 13 Touch position acquisition part 14 Area | region specific part 15 Display control part 16,23 Display part 17 Memory | storage part 18 Communication part 19 Control part 21 Microphone 22 Speaker 24 Operation part 25 Sensor part 26 Electric power Unit 27 Radio unit 28 Short-range communication unit 29 Auxiliary storage device 30 Main storage device 31 CPU
32 Drive device 33 Recording medium 40 Basic image 41 Menu bar 42 Setting input screen 43 Button 51 Finger 52 Part 53 Traced area 54 Closed loop area 55 Area 56 Rectangular area 60, 80 Screen 61, 71 Extraction target area 62 Non-extraction target area 63, 72 Save button 70 Capture screen 73 Cancel button 81 Thumbnail image

Claims (3)

Of the trajectory of the touch operation on the display image, when the midway portion between the start point and end point of the trajectory is located outside the rectangular area having the start point and end point as a diagonal line, at least the midway portion protrudes. Specify a rectangular area that is an extension of the rectangular area as an extraction target,
An image processing program that causes a computer to execute processing. Information processing device
Of the trajectory of the touch operation on the display image, when the midway portion between the start point and end point of the trajectory is located outside the rectangular area having the start point and end point as a diagonal line, at least the midway portion protrudes. Specify a rectangular area that is an extension of the rectangular area as an extraction target,
An image processing method.   Of the trajectory of the touch operation on the display image, when the midway portion between the start point and end point of the trajectory is located outside the rectangular area having the start point and end point as a diagonal line, at least the midway portion protrudes. An information processing apparatus comprising: an area specifying unit that specifies a rectangular area obtained by expanding the rectangular area as an extraction target.