JP2017021468A - Electronic apparatus, image processing method, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve convenience for a user in performing image reversal processing.SOLUTION: In one aspect, an electronic apparatus comprises a control part that extracts, from subjects included in an image, a subjects matching a predetermined condition as a predetermined subject in which a subject is not reversed as a mirror image, reverses an image from which an image of the predetermined subject is removed as a mirror image, and composes the image of the predetermined subject to a resulting reversed image. Thus, when the image is subjected to reversal processing, the electronic apparatus can avoid a situation where a user has difficulty in recognizing characters included in the image and an object indicating a direction, and improve convenience for the user in performing image reversal processing.SELECTED DRAWING: Figure 1

Description

  The present application relates to an electronic device, an image processing method, and an image processing program.

  2. Description of the Related Art Conventionally, there is a technique for reversing an image captured by a camera in an electronic device equipped with the camera.

JP 2012-84975 A

  When the image is inverted, it is difficult to recognize characters in the image that has been inverted and to recognize the time indicated by the clock. As described above, when the image is reversed, there is a subject that is not desired to be reversed.

  An electronic apparatus according to one aspect extracts an image of a subject that satisfies a predetermined condition as a non-inverted image that is not inverted as a mirror image from subjects included in the image, and the image excluding the non-inverted image is extracted. A control unit for synthesizing the non-inverted image after being inverted as a mirror image is provided.

  An image processing method according to one aspect is an image processing method executed by an image processing apparatus, and includes acquiring an image, and selecting an image of a subject that satisfies a predetermined condition from among subjects included in the image. Extracting the non-inverted image as a mirror image and reversing the image excluding the non-inverted image as a mirror image, and then synthesizing the non-inverted image.

  An image processing program according to an aspect includes a step of acquiring an image in an electronic device, and extracting, from the subjects included in the image, an image of a subject that satisfies a predetermined condition as a non-inverted image that is not inverted as a mirror image And a step of inverting the image excluding the non-inverted image as a mirror image and then synthesizing the non-inverted image.

FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the embodiment. FIG. 2 is a diagram illustrating an example of an image when the image is inverted by a conventional method. FIG. 3 is a diagram illustrating an example of an image when the image is inverted by the method according to the embodiment. FIG. 4 is a diagram illustrating another example of an image when the image is inverted by a conventional method. FIG. 5 is a diagram illustrating another example of an image when the image is inverted by the method according to the embodiment. FIG. 6 is a flowchart illustrating a process flow of the smartphone according to the embodiment. FIG. 7 is a flowchart illustrating a process flow of the smartphone according to the embodiment.

  A plurality of embodiments for carrying out an electronic device, an image processing method, and an image processing program according to the present application will be described in detail with reference to the drawings. In the following embodiments, a smartphone will be described as an example of an electronic device.

  An example of a functional configuration of the smartphone according to the embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the embodiment. In the following description, the same code | symbol may be attached | subjected about the same component. Furthermore, duplicate descriptions may be omitted.

  As shown in FIG. 1, the smartphone 1 includes a touch screen display 2, a button 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, a storage 9, and a controller 10. A speaker 11, a camera 12, a camera 13, a connector 14, an acceleration sensor 15, and an orientation sensor 16.

  The touch screen display 2 includes a display 2A and a touch screen 2B. The display 2A and the touch screen 2B may be positioned, for example, may be positioned side by side, or may be positioned apart from each other. When the display 2A and the touch screen 2B are positioned so as to overlap each other, for example, one or more sides of the display 2A may not be along any of the sides of the touch screen 2B.

  The display 2A includes a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminescence Display), or an inorganic EL display (IELD: Inorganic Electro-Luminescence Display). The display 2A displays characters, images, symbols, graphics, and the like. The screen including characters, images, symbols, graphics, and the like displayed on the display 2A includes a screen called a lock screen, a screen called a home screen, and an application screen displayed during execution of the application. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen, or a launcher screen. The display 2A is an example of a display unit.

  The touch screen 2B detects contact or proximity of a finger, pen, stylus pen, or the like to the touch screen 2B. The touch screen 2B can detect a position on the touch screen 2B when a plurality of fingers, pens, stylus pens, or the like are in contact with or close to the touch screen 2B. A plurality of fingers, pens, stylus pens, and the like detected by the touch screen 2B may be referred to as “finger”. A position where the finger detected by the touch screen 2B touches or approaches is sometimes referred to as a “detected position”. The touch screen 2B notifies the controller 10 of the contact of the finger with the touch screen 2B together with the detection position. The touch screen display 2 having the touch screen 2B can execute operations that can be performed by the touch screen 2B. In other words, the operation performed by the touch screen 2B may be performed by the touch screen display 2.

  The touch screen 2B may employ any method such as a capacitance method, a resistive film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method as a detection method. .

  The controller 10 is based on at least one of the contact detected by the touch screen 2B, the position at which the contact is detected, the change in the position at which the contact is detected, the interval at which the contact is detected, and the number of times the contact is detected. The type of gesture is determined. The smartphone 1 having the controller 10 can execute operations that the controller 10 can perform. In other words, the operation performed by the controller 10 may be performed by the smartphone 1. The gesture is an operation performed on the touch screen 2B using a finger. The operation performed on the touch screen 2B may be performed on the touch screen display 2 having the touch screen 2B. The gestures that the controller 10 determines via the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. It is not limited to.

  The button 3 receives an operation input from the user. The number of buttons 3 may be singular or plural.

  The illuminance sensor 4 detects illuminance. The illuminance is the value of the light beam incident on the unit area of the measurement surface of the illuminance sensor 4. The illuminance sensor 4 is used for adjusting the luminance of the display 2A, for example.

  The proximity sensor 5 detects the presence of a nearby object without contact. The proximity sensor 5 detects the presence of an object based on a change in a magnetic field or a change in a feedback time of an ultrasonic reflected wave. The proximity sensor 5 detects, for example, that the display 2A is close to the face. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

  The communication unit 6 communicates wirelessly. The wireless communication standards supported by the communication unit 6 include cellular phone communication standards such as 2G, 3G, and 4G, and short-range wireless communication standards, for example. Cellular phone communication standards include, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (registered trademark) (Worldwide InterPirality, PD). Examples thereof include GSM (registered trademark) (Global System for Mobile Communications), PHS (Personal Handy-phone System), and the like. Examples of short-range wireless communication standards include IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), and WPAN (Wireless Personal Area Network). The WPAN communication standard includes, for example, ZigBee (registered trademark). The communication unit 6 may support one or more of the communication standards described above.

  The receiver 7 is an example of a sound output unit. The receiver 7 outputs the sound signal transmitted from the controller 10 as sound. The receiver 7 can output, for example, the sound of a moving image reproduced on the smartphone 1, the sound of music, and the voice of the other party during a call. The microphone 8 is an example of a sound input unit. The microphone 8 converts a user's voice or the like into a sound signal and transmits the sound signal to the controller 10.

  The storage 9 stores programs and data. The storage 9 is also used as a work area for temporarily storing the processing result of the controller 10. The storage 9 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a storage medium such as a memory card, an optical disk, or a magneto-optical disk and a storage medium reader. The storage 9 may include a storage device used as a temporary storage area such as a RAM (Random Access Memory).

  The programs stored in the storage 9 include an application executed in the foreground or the background, and a control program (not shown) that supports the operation of the application. The application screen is displayed on the display 2A when executed in the foreground, for example. The control program includes an OS, for example. The application and the basic program may be installed in the storage 9 via wireless communication by the communication unit 6 or a non-transitory storage medium.

  The storage 9 stores an image processing program 9A, a camera application 9B, a telephone application 9C, image data 9Z, and the like.

  The image processing program 9A extracts, from the subjects included in the image, a subject image that matches a predetermined condition as a non-inverted image that is not inverted as a mirror image, and inverts the image excluding the non-inverted image as a mirror image. Later, a function of synthesizing a non-inverted image can be provided. The predetermined condition includes a case where the subject is character information and a case where the subject is an object indicating a direction. The object indicating the direction includes a clock.

  The image processing program 9A can provide a function of highlighting a non-inverted image that is not inverted as a mirror image.

  When the image processing program 9A receives an operation for designating a region on the image displayed on the display 2A, the image processing program 9A extracts a subject image included in the region as a non-inverted image regardless of the predetermined condition described above. Can provide.

  The camera application 9B can provide a function for performing shooting, editing and management of still images and moving images. The telephone application 9C provides a telephone call function for a telephone call by wireless communication.

  The image data 9Z includes still image data and moving image data. The image data 9Z includes still image data and moving image data captured by self-photographing.

  The storage 9 is used for processing executed based on functions provided by the image processing program 9A and the like, and processing executed based on functions provided by the camera application 9B and the like, in addition to the above programs and data. Various data may be stored. Data used for processing executed based on functions provided by the image processing program 9A or the like includes a pattern for performing collation with information extracted as character information from the image.

  The controller 10 includes an arithmetic processing device. The arithmetic processing unit includes, for example, a CPU (Central Processing Unit), an SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor. It is not limited. The controller 10 controls various operations of the smartphone 1 to realize various functions. The controller 10 is an example of a control unit.

  Specifically, the controller 10 executes instructions included in the program stored in the storage 9 while referring to the data stored in the storage 9 as necessary. And the controller 10 controls a function part according to data and a command, and implement | achieves various functions by it. The functional unit includes, for example, the display 2A, the communication unit 6, the microphone 8, and the speaker 11, but is not limited thereto. The controller 10 may change the control according to the detection result of the detection unit. Examples of the detection unit include, but are not limited to, the touch screen 2B, the button 3, the illuminance sensor 4, the proximity sensor 5, the microphone 8, the camera 12, the camera 13, the acceleration sensor 15, and the azimuth sensor 16.

  By executing the image processing program 9A, the controller 10 extracts, from the subjects included in the image, a subject image that meets a predetermined condition as a non-inverted image that is not inverted as a mirror image, and removes the non-inverted image. After the inverted image is inverted as a mirror image, a process for synthesizing the non-inverted image is realized. The predetermined condition includes a case where the subject is character information and a case where the subject is an object indicating a direction. The object indicating the direction includes a clock.

  The controller 10 extracts an image of character information included in the image as a non-inverted image. A method for extracting character information will be specifically described. By using optical character recognition or digital character recognition, handwritten characters and printed characters can be optically read even if the image includes portions other than character information. And it can extract as character information by specifying a character by collation with the pattern memorize | stored beforehand and converting it into a character. For example, when the small subject B that is character information is included in the large subject A that is not character information, the controller 10 extracts only the image of the subject B as a non-inverted image. Then, after the subject A is inverted, the subject B is synthesized on the inverted subject A. Further, the controller 10 extracts an image of an object indicating the direction included in the image as a non-inverted image. A method for extracting an object indicating a direction will be specifically described. For example, an object in the shape of an arrow is recognized as an image of an object pointing in the direction. In particular, when it is recognized that two or three arrows intersect, or when the arrows are surrounded by numerals, the clock is recognized. Here, the arrow is not limited to this, although it is sufficient to recognize the image of a pointed linear object as an arrow.

  After extracting the non-inverted image, the controller 10 inverts the image excluding the non-inverted image. For the inversion process, for example, a conventional technique for reversing the image horizontally (mirroring) may be used as it is, for example, by reversing the arrangement of pixels constituting the image.

  After the reversal process, the controller 10 combines the non-reversed image with the reversal-processed image. In particular, when the non-inverted image is character information, if the area from which the non-inverted image is extracted is whitened or blackened and then synthesized, the original character information before inversion is displayed. Therefore, it is possible to reduce the occurrence of a complicated image due to overlapping with the character information of the non-inverted image.

  When displaying the non-inverted image, the controller 10 may highlight the image in a manner different from that of the other inverted image.

  Hereinafter, an example of the control of the smartphone 1 executed by the controller 10 will be described with reference to FIGS. 2 to 5. 2 to 5 are diagrams illustrating examples of control by the smartphone according to the embodiment.

  FIG. 2 is a diagram illustrating an example of an image when the image is inverted by a conventional method. FIG. 3 is a diagram illustrating an example of an image when the image is inverted by the method according to the embodiment. When the smartphone 1 reverses the image including the user U1 and the character information OB1 by the conventional method, the display 2A is displayed in a state where both the image including the user U1 and the image including the character information OB1 are reversed as illustrated in FIG. Is displayed. On the other hand, when the smartphone 1 inverts the image including the user U1 and the character information OB1 by the method according to the embodiment, only the image including the user U1 is inverted as illustrated in FIG. The included image is displayed on the display 2A without being inverted. That is, the smartphone 1 extracts an image of the character information OB1 that matches a predetermined condition from subjects included in the image as a non-inverted image that is not inverted as a mirror image. Subsequently, the smartphone 1 reverses the image excluding the image of the character information OB1, and then synthesizes the image of the character information OB1. Therefore, as shown in FIG. 3, the image including the character information OB1 is displayed on the display 2A without being inverted.

  FIG. 4 is a diagram illustrating another example of an image when the image is inverted by a conventional method. FIG. 5 is a diagram illustrating another example of an image when the image is inverted by the method according to the embodiment. In the example shown in FIGS. 4 and 5, the object indicating the direction is an example of the watch OB2. When the smartphone 1 reverses the image including the user U1 and the clock OB2 by the conventional method, as shown in FIG. 4, the image including the user U1 and the image including the clock OB2 are displayed on the display 2A in a reversed state. Is done. In contrast, when the smartphone 1 inverts an image including the user U1 and the clock OB2 by the method according to the embodiment, as illustrated in FIG. 5, only the image including the user U1 is inverted and an image including the clock OB2 is displayed. Is displayed on the display 2A without being inverted. That is, the smartphone 1 extracts an image of the clock OB2 that matches a predetermined condition from subjects included in the image as a non-inverted image that is not inverted as a mirror image. Subsequently, the smartphone 1 inverts the image excluding the image of the clock OB2, and then synthesizes the image of the clock OB2. For this reason, as shown in FIG. 5, the image including the clock OB2 is displayed on the display 2A without being inverted.

  When the controller 10 receives an operation for designating a region in the image from the user via the touch screen 2B on the image displayed on the display 2A, the controller 10 displays the image of the subject included in the region as a non-inverted image. Can also be extracted. At this time, the controller 10 extracts the non-inverted image regardless of whether the subject included in the region designated by the user is character information or an object indicating the direction. In this case, the controller 10 extracts, for example, an image of character information, an image of an object indicating a direction, and an image of a subject included in an area designated by the user as an image of a subject that meets a predetermined condition.

  The speaker 11 includes a sound output unit. The speaker 11 outputs the sound signal transmitted from the controller 10 as sound. The speaker 11 may output a ring tone and music, for example. One of the receiver 7 and the speaker 11 may also function as the other.

  The camera 12 and the camera 13 can convert the captured image into an electrical signal. The camera 12 may be an in-camera that captures an object facing the display 2A. The camera 13 may be an out camera that captures an object facing the opposite surface of the display 2A. The camera 12 and the camera 13 may be mounted on the smartphone 1 in a functionally and physically integrated state as a camera unit that can be used by switching between the in-camera and the out-camera.

  The connector 14 is a terminal to which another device is connected. The connector 14 may be a general-purpose terminal such as USB (Universal Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), Light Peak (Thunderbolt (registered trademark)), and an earphone microphone connector. . The connector 14 may be a dedicated terminal such as a dock connector. Devices connected to the connector 14 include, but are not limited to, an external storage, a speaker, and a smartphone, for example.

  The acceleration sensor 15 detects the direction and magnitude of acceleration acting on the smartphone 1. The direction sensor 16 detects, for example, the direction of geomagnetism, and detects the direction (azimuth) of the smartphone 1 based on the direction of geomagnetism.

  The smartphone 1 may include a GPS receiver and a vibrator in addition to the above functional units. The GPS receiver can receive a radio signal of a predetermined frequency band from a GPS satellite. The GPS receiver demodulates the received radio signal and sends the processed signal to the controller 10. The GPS receiver supports the calculation processing of the current position of the smartphone 1. The vibrator vibrates a part or the whole of the smartphone 1. The vibrator includes, for example, a piezoelectric element or an eccentric motor in order to generate vibration. A functional unit that is naturally used to maintain the function of the smartphone 1, such as a battery, and a control unit that is naturally used to realize control of the smartphone 1 are mounted on the smartphone 1.

  The flow of processing executed by the smartphone 1 according to the embodiment will be described with reference to FIGS. 6 and 7. 6 and 7 are flowcharts showing a process flow of the smartphone according to the embodiment. The processing shown in FIGS. 6 and 7 is realized by the controller 10 executing the image processing program 9A stored in the storage 9.

  FIG. 6 shows an example of processing for extracting an image of a subject that matches a predetermined condition from the image as a non-inverted image. As shown in FIG. 6, the controller 10 reads an image from the storage 9 (step S101).

  Subsequently, the controller 10 determines whether there is a subject that meets a predetermined condition in the image read in step S101 (step S102). The predetermined condition includes a case where the subject is character information and a case where the subject is an object indicating a direction.

  As a result of the determination, if there is a subject that matches a predetermined condition in the image (Yes in step S102), the controller 10 extracts an image of the subject that matches the predetermined condition as a non-inverted image (step S103).

  Subsequently, the controller 10 inverts the image excluding the non-inverted image (step S104). Subsequently, the controller 10 synthesizes the non-inverted image extracted in step S103 with respect to the image inverted in step S104 (step S105), and ends the process shown in FIG.

  In the above step S102, if the result of determination is that there is no subject matching the predetermined condition in the image (step S102, No), the controller 10 inverts the image read in step S101 as it is (step S106). Then, the process shown in FIG.

  FIG. 7 shows an example of processing in which a user selects a non-inverted image as well as extracts a subject image that matches a predetermined condition from the image as a non-inverted image. As shown in FIG. 7, the controller 10 reads an image from the storage 9 (step S201) and displays it on the display 2A (step S202).

  Subsequently, the controller 10 receives a selection operation of a subject that is not reversed on the image displayed on the display 2A (step S203).

  Subsequently, the controller 10 determines whether the selection operation is completed (step S204). For example, the controller 10 determines that the selection operation has been completed when the operation of the user who completes the selection operation is received.

  If the result of determination is that the selection operation has not been completed (No at Step S204), the controller 10 returns to Step S203 above. On the contrary, if the selection operation is completed as a result of the determination (Yes in Step S204), the controller 10 determines whether there is a subject that meets a predetermined condition in the image (Step S205). The predetermined condition includes a case where the subject is character information, a case where the subject is an object indicating a direction, and a case where the subject is included in an area designated by the user.

  As a result of the determination, if there is a subject that matches the predetermined condition in the image (Yes in step S205), the controller 10 extracts an image of the subject that matches the predetermined condition as a non-inverted image (step S206).

  Subsequently, the controller 10 inverts the image excluding the non-inverted image (step S207). Subsequently, the controller 10 synthesizes the non-inverted image extracted in step S206 with respect to the image inverted in step S207 (step S208), and ends the process shown in FIG.

  In the above step S205, if there is no subject that matches the predetermined condition in the image as a result of the determination (step S205, No), the controller 10 inverts the image read in step S201 as it is (step S209). Then, the process shown in FIG. That is, if there is no character information in the image, there is no object indicating the direction, or there is no subject included in the area specified by the user, the controller 10 inverts the image read in step S201 as it is.

  The processing illustrated in FIGS. 6 and 7 is not limited to the case where the processing is performed when an image read from a storage medium connected via the storage 9 or the connector 14 is reproduced. For example, it may be executed when an image captured by the camera 12 or the like is stored in the storage 9.

  In the above-described embodiment, the smartphone 1 extracts, from the subjects included in the image, a subject image that matches a predetermined condition as a non-inverted image that is not inverted as a mirror image, and an image excluding the non-inverted image as a mirror image After inversion, a non-inverted image is synthesized. Therefore, according to the embodiment, when the image is inverted, it is possible to avoid a situation in which it is difficult for the user to recognize an object indicating the character and the direction included in the image, and the user's Convenience can be improved.

  The processing described in the above embodiment can be applied to an electronic device having a function of capturing an image, a function of reproducing an image, and a function of storing an image, such as a mobile phone, a smartphone, and a tablet.

  The characterizing embodiments have been described in order to fully and clearly disclose the technology according to the appended claims. However, the appended claims should not be limited to the above-described embodiments, but all modifications and alternatives that can be created by those skilled in the art within the scope of the basic matters shown in this specification. Should be embodied by a possible configuration.

DESCRIPTION OF SYMBOLS 1 Smart phone 2A Display 2B Touch screen 3 Button 4 Illuminance sensor 5 Proximity sensor 6 Communication unit 7 Receiver 8 Microphone 9 Storage 9A Image processing program 9B Camera application 9C Telephone application 9Z Image data 10 Controller 11 Speaker 12 Camera 13 Camera 14 Connector 15 Acceleration sensor 16 Direction sensor

Claims (8)

An image of a subject that meets a predetermined condition is extracted from the subjects included in the image as a non-inverted image that is not inverted as a mirror image.
An electronic apparatus comprising: a control unit that synthesizes the non-inverted image after inverting the image excluding the non-inverted image as a mirror image.   The electronic device according to claim 1, wherein when the subject is character information, the control unit extracts an image of the character information as the non-inverted image.   The electronic device according to claim 1, wherein when the subject is an object indicating a direction, the control unit extracts an image of the object as the non-inverted image.   The electronic device according to claim 3, wherein the object indicating the direction includes a clock.   The electronic device according to claim 1, wherein the control unit highlights the predetermined subject. A display unit for displaying an image;
The controller is
The image of the subject included in the region is extracted as the non-inverted image regardless of the predetermined condition when an operation for designating the region on the image displayed on the display unit is received. The electronic device as described in any one. An image processing method executed by an electronic device,
Acquiring an image;
Extracting a subject image that matches a predetermined condition from the subjects included in the image as a non-inverted image that is not inverted as a mirror image;
An image processing method comprising: inverting the image excluding the non-inverted image as a mirror image and then synthesizing the non-inverted image. Electronic equipment,
Acquiring an image;
Extracting a subject image that matches a predetermined condition from the subjects included in the image as a non-inverted image that is not inverted as a mirror image;
An image processing program that executes the step of combining the non-inverted image after inverting the image excluding the non-inverted image as a mirror image.

Images