JP6011561B2 - Control device, head mounted display, and program - Google Patents

Description

  The present invention relates to a control device that controls a head display that can be mounted on a head, a control device, a head-mounted display including the head display, and a program.

  A technique for displaying a diagnostic image using a medical diagnostic apparatus is known. For example, specific examples of the diagnostic apparatus include an ultrasonic diagnostic apparatus, a magnetic resonance imaging (MRI) apparatus, and an X-ray computed tomography (CT) apparatus. The diagnostic video may include a video indicating a diagnostic result (hereinafter referred to as a result video) and a video other than the result video (hereinafter referred to as a menu video). Patent Document 1 discloses a technique for detecting a boundary of an object from an ultrasound image.

JP2013-81824A

  An optical see-through type head mounted display (HMD) may be used to show a user a diagnostic video corresponding to a video signal output from a medical diagnostic apparatus to the outside. There is a need to enlarge and display the result video on the display unit of the HMD and to allow the user to recognize the result video. However, with the above technique, the result video cannot be automatically extracted and displayed on the display unit of the HMD.

  The objective of this invention is providing the control apparatus which can display a result image | video on HMD automatically, the head display which has a head display which has a display part, and a control apparatus, and a program.

The control device according to the first aspect of the present invention includes: a receiving unit that receives an image frame every predetermined period; and a plurality of pixels that constitute the image frame between the image frames received every predetermined period. A first determination unit that determines whether or not the number of pixels in which at least one of a value, a G value, and a B value differs by a predetermined value or more is a predetermined number or more; and When it is determined that the number of pixels in which at least one of the B values differs by a predetermined value or more is at least a predetermined number, it is determined that at least one of the R value, the G value, and the B value is different by a predetermined value or more. A specifying unit that specifies a specific pixel region including a pixel; a second determination unit that determines whether an RGB value of a pixel in the specific pixel region satisfies a predetermined condition; and The RGB values of the pixels in the If it is determined that satisfy, magnify the image corresponding to the specific pixel region in accordance with the aspect ratio of the display unit and a first control means for displaying on the display unit, the second determining means, said As a predetermined condition, it is determined whether or not the RGB value of the pixel in the specific pixel area is a value representing a black and white image, and the RGB value of the pixel in the specific pixel area is If it is determined that the value representing said first control means is characterized isosamples enlarged image corresponding to the specific pixel region according to the aspect ratio of the display unit is displayed on the display unit .

According to the first aspect, the control device can enlarge the video corresponding to the specific pixel region and display the video on the display unit, so that the user can visually recognize the enlarged video corresponding to the specific pixel region. . Further, the control device can easily determine the specific pixel region.
The control device according to the second aspect of the present invention includes: a receiving unit that receives an image frame every predetermined period; and a plurality of pixels that constitute the image frame between the image frames received every predetermined period. A first determination unit that determines whether or not the number of pixels in which at least one of a value, a G value, and a B value differs by a predetermined value or more is a predetermined number or more; and When it is determined that the number of pixels in which at least one of the B values differs by a predetermined value or more is at least a predetermined number, it is determined that at least one of the R value, the G value, and the B value is different by a predetermined value or more. A specifying unit that specifies a specific pixel region including a pixel; a second determination unit that determines whether an RGB value of a pixel in the specific pixel region satisfies a predetermined condition; and The RGB values of the pixels in the And a first control unit that enlarges an image corresponding to the specific pixel area according to an aspect ratio of the display unit and causes the display unit to display the image, and the second determination unit includes: As a predetermined condition, it is determined whether the ratio of the RGB values of the pixels in the specific pixel area is a value representing a monochrome image, and the ratio of the RGB values of the pixels in the specific pixel area is determined by the second determination unit. When it is determined that the value represents a monochrome image, the first control unit enlarges the image corresponding to the specific pixel area according to the aspect ratio of the display unit and displays the enlarged image on the display unit. Characterize
According to the second aspect, the control device can enlarge the video corresponding to the specific pixel region and display the video on the display unit, so that the user can visually recognize the enlarged video corresponding to the specific pixel region. . Further, the control device can appropriately determine the specific pixel region.

In the first aspect or the second aspect , the first control unit enlarges an image corresponding to the specific pixel area according to an aspect ratio of the display unit of a display device that can be mounted on a head, and displays the image on the display unit. It may be displayed. In this case, the control device can cause the display unit to display an image corresponding to the specific pixel region enlarged according to the aspect ratio of the display unit.

A head mounted display according to a third aspect of the present invention includes the control device according to the first aspect or the second aspect and the display device. According to the 2nd aspect, there can exist an effect similar to a 1st aspect.

In the first aspect or the second aspect , when the second determination unit determines that the RGB value of the pixel in the specific pixel region satisfies a predetermined condition, the control device, the pixel in the specific pixel region Third determining means for determining whether or not the RGB value of the pixel in the specific pixel region is equal to or less than a predetermined value. The first control means enlarges an image corresponding to the specific pixel area according to the aspect ratio of the display section, displays the image on the display section with a first luminance, and the third determination means If the RGB value of the pixel in the specific pixel area is not determined to be equal to or less than a predetermined value, the first control unit displays an image corresponding to the specific pixel area according to an aspect ratio of the display unit. Enlarged than the first brightness In Rui second luminance may be displayed on the display unit. In this case, the control device can display the video corresponding to the specific pixel area so that the user can easily see the video corresponding to the specific pixel area even when the video corresponding to the specific pixel area is dark.

In the first aspect or the second aspect , when the first control unit determines that the RGB value of the pixel in the specific pixel region does not satisfy a predetermined condition by the second determination unit, You may provide the 2nd control means to display the image | video corresponding to the said image frame on the said display part by the 3rd brightness | luminance between the said 2nd brightness | luminances. In this case, the control device can display an image normally displayed on the display unit with a luminance that is easy for the user to see.

In the first aspect or the second aspect , the specifying unit determines that the number of pixels in which at least one of an R value, a G value, and a B value differs by a predetermined value or more by the first determination unit is a predetermined number or more. If it is determined, the specific pixel region including a pixel determined that at least one of the R value, the G value, and the B value is different from the predetermined value by a period equal to or less than the reception period of the image frame may be specified. Good. In this case, when the pixel change interval is equal to or less than the image frame reception cycle, the portion including the changed pixel is determined as the specific pixel region. Therefore, the control device can accurately specify an area including pixels that change at a period equal to or less than the reception period as the specific pixel area.

In the first aspect or the second aspect , at least one of an R value, a G value, and a B value among a plurality of pixels constituting the image frame between the image frames received every predetermined period by the first determination unit. When it is determined that the number of pixels that are different from each other by a predetermined value is not a predetermined number or more, a fourth determination unit that determines whether a predetermined time or more has passed without being a predetermined number or more, and the fourth determination unit, When it is determined that a predetermined time or more has elapsed, a third control unit that turns off the power of the display unit may be provided. In this case, the control device can suppress the power consumption of the head display.

A program according to a fourth aspect of the present invention includes a reception step of receiving an image frame every predetermined period and a plurality of pixels constituting the image frame between the image frames received every predetermined period by the reception step. In the first determination step for determining whether the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the R value, When it is determined that the number of pixels in which at least one of the G value and the B value differs by a predetermined value or more is at least a predetermined number, at least one of the R value, the G value, and the B value is different by a predetermined value or more. A specifying step of specifying a specific pixel region including the determined pixel, a second determination step of determining whether the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, and the second determination step. When it is determined that the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, an image corresponding to the specific pixel region is enlarged and displayed on the display unit according to an aspect ratio of the display unit. 1 control step is executed by the computer, and the second determination step determines, as the predetermined condition, whether the RGB value of the pixel in the specific pixel region is a value representing a monochrome image, and the second determination step. When the step determines that the RGB value of the pixel in the specific pixel area is a value representing a black and white image, the first control step corresponds to the specific pixel area according to the aspect ratio of the display unit The video to be displayed is enlarged and displayed on the display unit .
A program according to a fifth aspect of the present invention includes a reception step of receiving an image frame every predetermined period and a plurality of pixels constituting the image frame between the image frames received every predetermined period by the reception step. In the first determination step for determining whether the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the R value, When it is determined that the number of pixels in which at least one of the G value and the B value differs by a predetermined value or more is at least a predetermined number, at least one of the R value, the G value, and the B value is different by a predetermined value or more. A specifying step of specifying a specific pixel region including the determined pixel, a second determination step of determining whether the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, and the second determination step. When it is determined that the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, an image corresponding to the specific pixel region is enlarged and displayed on the display unit according to an aspect ratio of the display unit. 1 control step is executed by the computer, and the second determination step determines, as the predetermined condition, whether a ratio of RGB values of pixels in the specific pixel region is a value representing a monochrome image, and 2 When the determination step determines that the ratio of the RGB values of the pixels in the specific pixel region is a value representing a black-and-white image, the first control step determines the specific value according to the aspect ratio of the display unit. An image corresponding to the pixel region is enlarged and displayed on the display unit. According to the 4th aspect or the 5th aspect , there can exist an effect similar to a 1st aspect.

It is a perspective view of HMD1. It is a figure which shows the diagnostic image | video 76. It is a block diagram which shows the electric constitution of HMD1. It is a flowchart of a main process. It is a flowchart of an area | region identification process. It is a flowchart of the 1st expansion processing and the 2nd expansion processing. It is a flowchart of the area | region identification process in a modification.

  DESCRIPTION OF EMBODIMENTS Embodiments embodying the present invention will be described with reference to the drawings. An outline of a head mounted display (hereinafter referred to as HMD) 1 will be described with reference to FIG. In the present embodiment, the HMD 1 includes a display device (hereinafter referred to as a head display or HD) 10 and a control device (hereinafter referred to as a control box or CB) 50. In the following description, the upper, lower, diagonally lower right, diagonally upper left, diagonally upper right and diagonally lower left of FIG. 1 are the upper, lower, forward, rearward, right and left sides of the HMD 1, respectively. In the present embodiment, the display device 10 is a see-through type head-mountable display device.

  An outline of the HD 10 will be described. The HD 10 is attached to the spectacles 5 which is a dedicated wearing tool. The user wears the HD 10 on the head by using the glasses 5 to which the HD 10 is attached. In addition to the glasses 5, the HD 10 may be attached. The HD 10 can irradiate image light backward. The image light is incident on the left eye of the user wearing the HD 10. The HD 10 is detachably connected to the CB 50 via the harness 7. The HD 10 includes a housing 2, a half mirror 3, a display unit 15 (see FIG. 3), an eyepiece optical system (not shown), and the like as main components.

  The housing 2 is provided at the right end of the glasses 5. A half mirror 3 is provided on the left end side of the housing 2. The half mirror 3 is disposed in front of the user's left eye with the user wearing the HD 10 on the head. An eyepiece optical system and a display unit 15 are arranged in the housing 2 in order from the left side to the right side. The display unit 15 is a liquid crystal element. The display unit 15 displays an image corresponding to the image signal received from the CB 50 via the harness 7. The display surface of the display unit 15 faces leftward. Image light indicating an image displayed on the display unit 15 enters the eyepiece optical system from the right side and exits toward the half mirror 3 from the left side. The half mirror 3 reflects the image light emitted from the eyepiece optical system backward. In a state where the HMD 1 is worn by the user, the video light is incident on the eyeball of the user's left eye. The half mirror 3 transmits light from the real image of the outside world toward the left eye of the user. The HMD 1 allows the user to visually recognize a scene in which the video displayed on the display unit 15 is superimposed on a real image (for example, an external scenery) within the visual field range of the user.

  The glasses 5 can be held on the user's head by being worn on the user's head. The glasses 5 include a frame 6 and a support portion 4. Since the shape of the frame 6 is substantially the same as that of normal glasses, detailed description is omitted. A support 4 is provided at the right end of the upper surface of the rim that supports the left-eye lens in the frame 6. The support unit 4 holds the housing 2 of the HD 10. The support part 4 can move the holding position of the housing 2 in the vertical direction and the horizontal direction. The user can adjust the position so that the position of the eyeball of the left eye and the position of the half mirror 3 are aligned in the front-rear direction by moving the housing 2 in the vertical direction and the horizontal direction.

  The HD 10 may be attached to other wearing tools such as glasses, helmets, and headphones that are used on a daily basis by the user. The display unit 15 may be another spatial modulation element. For example, the display unit 15 may be a retinal scanning display unit that performs two-dimensional scanning with laser light having an intensity corresponding to a video signal, and an organic EL (Organic Electro-luminescence) display. In FIG. 1, the support portion 4 and the HD 10 are provided on the right side of the frame 6, but the support portion 4 and the HD 10 may be provided on the right side of the frame 6. In this case, the video light is incident on the right eyeball of the user while the HMD 1 is worn by the user.

  In the present embodiment, the HD 10 is a so-called optical see-through head display that has a function of allowing a user to visually recognize a scene in a state where an image displayed on the display unit 15 is superimposed on a real image of the outside world. However, the present invention may be a head display having another function. For example, the HD 10 is a so-called video see-through function that allows a user to visually recognize an image displayed on the display unit 15 and an external image captured by a camera without causing light from the real image of the external environment to enter the user's eyes. It may be a type of head display.

  An outline of the CB 50 will be described. CB50 is attached to a user's waist belt, an arm, etc., for example. The CB 50 controls the HD 10. The CB 50 is detachably connected to the HD 10 via the harness 7. The CB 50 includes a casing 63, a switch 61, an LED 62, an input terminal 72, and the like as main components. The shape of the housing 63 is a substantially rectangular parallelepiped with rounded edges. The switch 61 is a switch for performing various settings in the HD 10, various operations during use, and power on / off. The LED 62 is a light emitting element for notifying the user of the state of the HMD 1. The input terminal 72 is a terminal for receiving a video signal from a diagnostic device or a video device. A cable 71 for performing video signal communication is detachably connected to the input terminal 72. The video signal is a well-known digital signal indicating the RGB values of a plurality of pixels included in each of a plurality of image frames.

  An outline of the diagnostic apparatus will be described. The diagnostic apparatus is a well-known ultrasonic diagnostic apparatus that can detect an echo by irradiating an object with an ultrasonic wave and visualize the detected echo. Usually, a well-known monitor is connected to the diagnostic apparatus. In this case, the user performs diagnosis while viewing the video displayed on the monitor. On the other hand, in this embodiment, a CB 50 is connected to the diagnostic apparatus via a cable 72 instead of a monitor. In this case, the user makes a diagnosis while viewing the video via the HMD 1. The diagnostic device is not limited to the ultrasonic diagnostic device, and may be another diagnostic device. For example, the diagnostic apparatus may be a magnetic resonance imaging (MRI) apparatus, an X-ray computed tomography (CT) apparatus, or the like.

  An example of the diagnostic video 76 will be described with reference to FIG. The diagnostic video 76 is a video corresponding to a video signal output from the diagnostic device. The diagnostic video 76 includes a result video 77 and a menu video 78. The result image 77 is arranged at the approximate center of the diagnostic image 76. The result image 77 is a black and white image obtained by visualizing the echo of the ultrasonic waves. The result image 77 indicates the position (depth from the skin surface) in the body of the diagnosis target. The diagnostic object is, for example, various organs, blood vessels, tumors, and the like. The result image 77 changes according to the movement of the diagnostic object. The menu image 78 is a portion of the diagnostic image 76 excluding the result image 77. The menu video 78 is arranged on the left side, the right side, and the lower side of the result video 77. The menu image 78 includes a diagnosis method selection button, a diagnosis start button and an end button, a setting condition input button, a heart rate, and the like. The menu image 78 may include a date / time image 78A indicating the diagnosis date / time in units of one second. The menu image 78 other than the date / time image 78A does not change. The layout of the result video 77 and the menu video 78 in the diagnostic video 76 is not limited to the example of FIG. Hereinafter, the horizontal direction of the diagnostic image 76 is referred to as the X-axis direction, and the vertical direction is referred to as the Y-axis direction.

  An outline of the video apparatus will be described. The video device is a well-known AV device capable of outputting a video signal. Specific examples of the video apparatus include a PC, a video receiver, and a video camera. Hereinafter, the video displayed in accordance with the video signal output from the video device is referred to as a video video.

  The electrical configuration of the HMD 1 will be described with reference to FIG. First, the electrical configuration of the HD 10 will be described. The HD 10 includes a CPU 11 that controls the entire HD 10. The CPU 11 is electrically connected to the flash ROM 12, RAM 13, input control unit 14, and display unit 15. The flash ROM 12 stores a program executed by the CPU 11. The program is stored in the flash ROM 12 when the HMD 1 is shipped. The RAM 13 temporarily stores various data. The input control unit 14 is connected to the output control unit 59 of the CB 50 via the harness 7 (see FIG. 1). The input control unit 14 receives the video signal from the output control unit 59. The display unit 15 displays a video corresponding to the video signal.

  The HMD 1 may further include a wireless communication unit (not shown). The CPU 11 may download a program from a program download server via the wireless communication unit and store the program in the flash ROM 12. The flash ROM 12 may store a program executed by the CPU 51 of the CB 50. The CPU 11 may execute the same process as the process executed by the CPU 51 of the CB 50 instead of the CPU 51.

  The electrical configuration of the CB 50 will be described. The CB 50 includes a CPU 51 that controls the entire CB 50. The CPU 51 is electrically connected to the flash ROM 52, RAM 53, decoder 54, first ASIC 55, second ASIC 56, input buffer 57, peripheral interface (hereinafter referred to as peripheral I / F) 58, output control unit 59, and output buffer 60. The The decoder 54, the first ASIC 55, the second ASIC 56, and the input buffer 57 are electrically connected. The second ASIC 56 and the output buffer 60 are electrically connected. The output control unit 59 and the output buffer 60 are electrically connected. The flash ROM 52 stores a program executed by the CPU 51. The program is stored in the flash ROM 52 when the HMD 1 is shipped. The RAM 53 temporarily stores various data. The decoder 54 decodes the video signal received via the input terminal 72.

  The first ASIC 55 is an ASIC that can determine the region of the result video 77 (see FIG. 2) of the diagnostic video 76 when the video signal of the diagnostic video 76 (see FIG. 2) is received via the input terminal 72. is there. The second ASIC 56 is an ASIC capable of enlarging the result video 77 in accordance with the size of the display unit 15. The input buffer 57 stores the video signal data decoded by the decoder 54. The peripheral I / F 58 is connected to the switch 61 and the LED 62 and controls input / output of signals. The output control unit 59 is connected to the input control unit 14 of the HD 10 via the harness 7. The output control unit 59 outputs the video signal to the input control unit 14 of the HD 10 via the harness 7. The output buffer 60 stores the data of the result video 77 enlarged by the second ASIC 56. The determination process of the area of the result video 77 processed by the first ASIC 55 may be executed by the CPU 51 by executing a program stored in the flash ROM 52. The enlargement process of the result video 77 processed by the second ASIC 56 may be executed by the CPU 51 by executing a program stored in the flash ROM 52.

  The HMD 1 may further include a wireless communication unit (not shown). The CPU 51 may download a program from a program download server via the wireless communication unit and store the program in the flash ROM 52. The flash ROM 52 may store a program executed by the CPU 11 of the HD 10. The CPU 51 may execute the same process as the process executed by the CPU 11 of the HD 10 instead of the CPU 11.

  The main process executed by the CPU 51 of the CB 50 will be described with reference to FIG. When the CPU 51 detects that the video signal for one image frame received via the input terminal 72 has been decoded by the decoder 54, the CPU 51 starts processing based on the program stored in the flash ROM 52. The main process is started. The image frame is output from the diagnostic apparatus or the video apparatus at a predetermined frame period (for example, 1/60 second period). Accordingly, the CPU 51 receives a video signal for one image frame every predetermined period and starts main processing. Hereinafter, a case will be described as an example where the main processing is started in response to the decoding of the video signal of the Xth image frame (X is an integer equal to or greater than 1) after the power of the CB 50 is turned on. Data obtained by decoding the video signal corresponding to the Xth image frame is referred to as Xth video data.

  The CPU 51 receives the Xth video data from the decoder 54 (S71). The CPU 51 stores the received Xth video data in the input buffer 57 (S72). When the Xth video data is stored in the input buffer 57, the 1st to (X-1) th video data is stored in the input buffer 57. Based on the X-1th video data and the Xth video data stored in the input buffer 57, the CPU 51 determines the R value of the pixel at the same position in the X-1th image frame and the Xth image frame. The G value and B value are compared. The CPU 51 determines whether or not the number of pixels (hereinafter referred to as change pixels) in which at least one of the R value, the G value, and the B value differs by a predetermined first threshold value or more is a predetermined second threshold value or more. (S73). If the CPU 51 determines that the number of changed pixels is not equal to or greater than the second threshold (S73: NO), the CPU 51 determines whether or not the state where the number of changed pixels is less than the second threshold continues for a predetermined time (S101). ). When the CPU 51 determines that the state where the number of change pixels is less than the second threshold has continued for a predetermined time or longer (S101: YES), the CPU 51 turns off the power of the display unit 15 (S103). Note that the CPU 51 may stop outputting the video signal by the process of S99 described later, instead of turning off the power of the display unit 15 in the process of S103. When the CPU 51 determines that the state where the number of change pixels is less than the second threshold has not continued for a predetermined time or longer (S101: NO), the CPU 51 does not turn off the power of the display unit 15. When the CPU 51 determines that the number of changed pixels is equal to or greater than the second threshold (S73: YES), the CPU 51 outputs a first instruction signal to the first ASIC 55 (S75).

  The area specifying process executed by the first ASIC 55 will be described with reference to FIG. When the first ASIC 55 detects the first instruction signal output from the CPU 51, the first ASIC 55 starts the area specifying process. The first ASIC 55 initializes the variables P1, P2, P3, P4, and n stored in the input buffer 57 by setting them to 0 (S31). The variable P1 indicates the maximum Y coordinate. A variable P2 indicates the minimum Y coordinate. The variable P3 indicates the maximum X coordinate. The variable P4 indicates the minimum X coordinate. The variable n indicates the order of each of the plurality of pixels included in the image frame.

  The first ASIC 55 is based on the 1st to (X-1) th video data stored in the input buffer 57, and the R value, G value, and B value of the variable nth pixel in each of the 1st to (X-1) th image frames. The average value of each is calculated (S35). Hereinafter, the average value of each of the R value, the G value, and the B value is referred to as an integrated average value. The first ASIC 55 includes an R value, a G value, and a B value of the variable n-th pixel of the Xth image frame, an integrated average value of the R value, an integrated average value of the G value, and an integrated average value of the B value, respectively. Are compared (S37). The first ASIC 55 includes an R value, a G value, and a B value of the variable n-th pixel of the Xth image frame, an integrated average value of the R value, an integrated average value of the G value, and an integrated average value of the B value, respectively. Are determined to match (S37: YES), 1 is added to the variable n (S39). The first ASIC 55 executes the process of S35 again.

  The first ASIC 55 includes an R value, a G value, and a B value of the variable n-th pixel of the Xth image frame, an integrated average value of the R value, an integrated average value of the G value, and an integrated average value of the B value, respectively. If it is determined that at least one of them is different (S37: NO), the Y coordinate indicating the position of the variable n-th pixel is compared with the variable P1 (S41). If the first ASIC 55 determines that the variable P1 is smaller than the Y coordinate indicating the position of the variable nth pixel (S41: YES), the first ASIC 55 sets the variable P1 to the Y coordinate indicating the position of the variable nth pixel. (S43). The first ASIC 55 executes the process of S45. When the first ASIC 55 determines that the variable P1 is not smaller than the Y coordinate indicating the position of the variable n-th pixel (S41: NO), the first ASIC 55 executes the process of S45.

  The first ASIC 55 compares the Y coordinate indicating the position of the variable n-th pixel with the variable P2 (S45). When the first ASIC 55 determines that the variable P2 is larger than the Y coordinate indicating the position of the variable nth pixel (S45: YES), the variable P2 is set to the Y coordinate indicating the position of the variable nth pixel. (S47). The first ASIC 55 executes the process of S49. If the first ASIC 55 determines that the variable P2 is not larger than the Y coordinate indicating the position of the variable n-th pixel (S45: NO), the first ASIC 55 executes the process of S49.

  The first ASIC 55 compares the X coordinate indicating the position of the variable n-th pixel with the variable P3 (S49). When the first ASIC 55 determines that the variable P3 is smaller than the X coordinate indicating the position of the variable nth pixel (S49: YES), the first ASIC 55 sets the variable P3 to the X coordinate indicating the position of the variable nth pixel. (S51). The first ASIC 55 executes the process of S53. When the first ASIC 55 determines that the variable P3 is not smaller than the X coordinate indicating the position of the variable n-th pixel (S49: NO), the first ASIC 55 executes the process of S53.

  The first ASIC 55 compares the X coordinate indicating the position of the variable n-th pixel with the variable P4 (S53). When the first ASIC 55 determines that the variable P4 is larger than the X coordinate indicating the position of the variable nth pixel (S53: YES), the first ASIC 55 sets the variable P4 to the X coordinate indicating the position of the variable nth pixel. (S55). The first ASIC 55 executes the process of S57. When the first ASIC 55 determines that the variable P4 is not larger than the X coordinate indicating the position of the variable n-th pixel (S53: NO), the first ASIC 55 executes the process of S57.

  The first ASIC 55 determines whether the total number of pixels N of the image frame matches the variable n (S57). If the first ASIC 55 determines that the total number of pixels N does not match the variable n (S57: NO), the first ASIC 55 adds 1 to the variable n (S59). The first ASIC 55 executes the process of S35 again. If the first ASIC 55 determines that the total number of pixels N and n match (S57: YES), the first ASIC 55 outputs a first notification signal to the CPU 51 (S61).

  As shown in FIG. 4, the CPU 51 detects the first notification signal output from the first ASIC 55 after outputting the first instruction signal to the first ASIC 55 (S76). The CPU 51, based on the variables P1 to P4 stored in the input buffer 57, is an area surrounded by a rectangle having coordinates (P3, P1) (P3, P2) (P4, P1) (P4, P2) as four vertices. Is specified as a specific pixel region (S77). The CPU 51 determines whether the ratio of the R value, the G value, and the B value of the plurality of pixels in the specific pixel area of the Xth image frame is approximately 1: 1: 1 (S78). Specifically, the CPU 51 determines that the ratio is approximately 1: 1: 1 when the difference between the R value, the G value, and the B value of a plurality of pixels is within a few percent of each value.

  When the ratio of the R value, G value, and B value of a plurality of pixels in the specific pixel area of the Xth image frame is approximately 1: 1: 1, the video corresponding to the specific pixel area is a black and white video. In addition, the image corresponding to the specific pixel region has changed. As described with reference to FIG. 2, the result image 77 is shown as a black and white image, and changes according to the movement of the diagnostic object. Therefore, when the ratio of the R value, the G value, and the B value is approximately 1: 1: 1, the video corresponding to the received video signal is the diagnostic video 76 (see FIG. 2) and corresponds to the specific pixel region. The video is a result video 77 (see FIG. 2). On the other hand, when the ratio of the R value, G value, and B value of the plurality of pixels in the specific pixel area of the Xth image frame is not approximately 1: 1: 1, the video corresponding to the specific pixel area is a color video. Note that the video image corresponding to the image signal output from the image device is a color image. Therefore, when the ratio of the R value, the G value, and the B value is not approximately 1: 1: 1, the video corresponding to the received video signal is a video video.

  When the CPU 51 determines that the ratio of the R value, the G value, and the B value of the plurality of pixels in the specific pixel region of the Xth image frame is approximately 1: 1: 1 (S78: YES), the specific pixel region It is determined whether any of an average value of R values, an average value of G values, and an average value of B values of a plurality of pixels is equal to or less than a predetermined third threshold value (S87). When the CPU 51 determines that any one of the average value of the R value, the average value of the G value, and the average value of the B value is equal to or less than the third threshold (S87: YES), the luminance of the video corresponding to the specific pixel region Is set to a predetermined first luminance (S89). CPU51 performs the process of S93. If the CPU 51 determines that any one of the average value of the R value, the average value of the G value, and the average value of the B value is not equal to or less than the third threshold (S87: NO), the luminance of the video corresponding to the specific pixel region Is set to a predetermined second luminance brighter than the first luminance (S91). CPU51 performs the process of S93. The CPU 51 outputs the second instruction signal to the second ASIC 56 (S93). In this embodiment, the average value of the R value, the average value of the G value, and the average value of the B value are used. However, the total value of the R values of the plurality of pixels in the specific pixel region, The total value and the total value of the B values may be used.

  The first enlargement process executed by the second ASIC 56 will be described with reference to FIG. When the second ASIC 56 determines that the second instruction signal output from the CPU 51 has been detected, the second ASIC 56 starts the first enlargement process. When the second ASIC 56 determines that the second instruction signal has been detected (S49: YES), the video corresponding to the specific pixel region is selected from the Xth image frame based on the variables P1 to P4 stored in the input buffer 57. Cut out (S50). Hereinafter, the clipped video is referred to as a specific area video. The second ASIC 56 compares the ratio between the length in the X-axis direction and the length in the Y-axis direction of the specific area image and the ratio between the length in the X-axis direction and the length in the Y-axis direction of the display unit 15 (S51). Hereinafter, the ratio between the length in the X-axis direction and the length in the Y-axis direction is referred to as an aspect ratio. When the second ASIC 56 determines that the aspect ratio of the specific area video is the same as the aspect ratio of the display unit 15 (S51: YES), the second ASIC 56 determines the length of the specific area video in the X-axis direction of the display unit 15 And the enlargement ratio of the specific area video when the length of the specific area video in the Y-axis direction matches the length of the display unit 15 in the Y-axis direction is calculated. The second ASIC 56 enlarges the specific area video at the calculated enlargement ratio (S53). The second ASIC 56 stores the video data of the enlarged specific area video in the output buffer 60 (S57). The second ASIC 56 outputs a second notification signal to the CPU 51 (S59).

  When the second ASIC 56 determines that the aspect ratio of the specific area video and the aspect ratio of the display unit 15 are not the same (S51: NO), the length of the display unit 15 in the X-axis direction is longer in the Y-axis direction. If it is longer than this, the enlargement ratio of the specific area image when the length of the specific area image in the X-axis direction is made to coincide with the length of the display unit 15 in the X-axis direction is calculated. When the length of the display unit 15 in the Y-axis direction is longer than the length of the X-axis direction, the second ASIC 56 sets the length of the specific area image in the Y-axis direction to the length of the display unit 15 in the Y-axis direction. Then, the enlargement ratio of the specific area image is calculated. The second ASIC 56 enlarges the specific area image at the calculated enlargement ratio (S55). The second ASIC 56 stores the video data of the enlarged specific area video in the output buffer 60 (S57). The second ASIC 56 outputs a second notification signal to the CPU 51 (S59).

  As shown in FIG. 4, the CPU 51 detects the second notification signal output from the second ASIC 56 after outputting the second instruction signal to the second ASIC 56 (S95). The CPU 51 sends the video signal corresponding to the video data stored in the output buffer 60 and the luminance signal indicating the first luminance or the second luminance set by the processing of S89 or S91 via the output control unit 59 to the HD 10. To the input control unit 14 (S99). The CPU 11 of the HD 10 causes the display unit 15 to display a video corresponding to the video signal received from the CPU 51 of the CB 50 via the input control unit 14 (enlarged specific area video) with a luminance corresponding to the received luminance signal. The user of the HD 10 displays the enlarged specific area image on the display unit 15, and thus the result image 77 (FIG. 2) larger than the case where the entire diagnosis image 76 (see FIG. 2) is displayed on the display unit 15. See).

  When the CPU 51 determines that the ratio of the R value, the G value, and the B value of the plurality of pixels in the specific pixel area of the Xth image frame is not approximately 1: 1: 1 (S78: NO), the brightness of the video is determined. The third brightness indicating the brightness between the first brightness and the second brightness is set (S79). The CPU 51 outputs a third instruction signal to the second ASIC 56 (S81).

  The second enlargement process executed by the second ASIC 56 will be described with reference to FIG. When the second ASIC 56 determines that the third instruction signal output from the CPU 51 is detected, the second ASIC 56 starts the second enlargement process. If the second ASIC 56 determines that the second instruction signal has not been detected (S49: NO), the second ASIC 56 does not perform the process of cutting out the specific pixel region (S50), and performs S51 on the entire video corresponding to the Xth image frame. , S53 and S55 are executed. In the CPU 51, the processes of S51, S53, and S55 are the same as the first enlargement process that is executed when the second instruction signal is output from the CPU 51 in the process of S93, and thus the description thereof is omitted. The second ASIC 56 stores the video data of the enlarged video in the output buffer 60 (S57). The second ASIC 56 outputs a third notification signal to the CPU 51 (S59).

  As shown in FIG. 4, the CPU 51 detects the third notification signal output from the second ASIC 56 after outputting the third instruction signal to the second ASIC 56 (S83). The CPU 51 sends the video signal corresponding to the video data stored in the output buffer 60 and the luminance signal indicating the third luminance set by the process of S79 to the input control unit 14 of the HD 10 via the output control unit 59. Output (S99). The CPU 11 of the HD 10 causes the display unit 15 to display the video corresponding to the video signal received from the CPU 51 of the CB 50 via the input control unit 14 with the third luminance corresponding to the luminance signal. HD10 users can view video images.

  As described above, the CPU 51 determines whether or not the number of changed pixels among the plurality of pixels included in the image frame is equal to or greater than the second threshold (S73). When the CPU 51 determines that the number of changed pixels is equal to or greater than the second threshold (S73: YES), the CPU 51 causes the first ASIC 55 to identify the specific pixel region (S75, S76, S77). When the RGB values of the pixels in the specific pixel area satisfy the predetermined condition (S78: YES), the CPU 51 enlarges the video corresponding to the specific pixel area to the second ASIC 56 according to the aspect ratio of the display unit 15 (S93, S95). ), And outputs the video signal of the enlarged video to the HD 10 (S99). The CPU 11 of the HD 10 causes the display unit 15 to display a video corresponding to the received video signal. The specific pixel region corresponds to a region of a result image 77 indicating a diagnosis result in the diagnosis image 76 corresponding to the image signal output from the diagnosis apparatus. Accordingly, since the result video 77 is enlarged and displayed on the display unit 15, the user of the HMD 1 can recognize the result video 77 well.

  The CPU 51 determines whether or not the video corresponding to the specific pixel area is a black and white video, and the ratio of the R value, the G value, and the B value of each of the plurality of pixels in the specific pixel area is approximately 1: 1: 1. It is determined by whether or not there is (S78). When the CPU 51 determines that the ratio is approximately 1: 1: 1, the CPU 51 determines that the video corresponding to the specific pixel area is a black and white video. In this case, the CPU 51 enlarges the video corresponding to the specific pixel area to the second ASIC 56 according to the aspect ratio of the display unit 15 (S93, S95), and outputs the video signal of the enlarged video to the HD 10 (S99). Since the result video 77 is a black and white video, the CPU 51 can easily and appropriately determine the result video 77 and display it on the display unit 15.

  When the aspect ratio of the video corresponding to the specific pixel region is the same as that of the display unit 15 (S51: YES), the second ASIC 56 sets the lengths of the video corresponding to the specific pixel region in the X-axis direction and the Y-axis direction. Then, the image corresponding to the specific pixel region is enlarged at an enlargement ratio when the length of the display unit 15 matches the length in the X-axis direction and the Y-axis direction (S53). On the other hand, when the aspect ratio is different between the video corresponding to the specific pixel area and the display unit 15 (S51: NO), the second ASIC 56 displays the length of the video corresponding to the specific pixel area in the X-axis direction. The image corresponding to the specific pixel region is enlarged at an enlargement rate when the length of the image matches the length in the X-axis direction (S55). Thus, the CPU 51 can display a larger result video 77 on the display unit 15 by making maximum use of the display unit 15.

  The CPU 51 determines whether any of the average value of the R values, the average value of the G values, and the average value of the B values of the plurality of pixels in the specific pixel region is equal to or less than the third threshold value (S87). When the CPU 51 determines that any one is equal to or less than the third threshold (S87: YES), the CPU 51 sets the video brightness to the first brightness (S89). If the CPU 51 determines that none of them is equal to or less than the third threshold value (S87: NO), it sets the luminance of the video to a second luminance that is brighter than the first luminance (S91). Note that when any of the average value of the R value, the average value of the G value, and the average value of the B value is greater than or equal to the third threshold value, the luminance of the video is darker than when any of the average value is equal to or less than the third threshold value. Therefore, in this case, the CPU 51 sets the second luminance brighter than the first luminance. Thereby, the CPU 51 can make it easier for the user to see the result video 77.

  When the CPU 51 determines that the ratio of the R value, the G value, and the B value of the plurality of pixels in the specific pixel region is not approximately 1: 1: 1 (S78: NO), the luminance of the video is set to the first luminance and the first luminance. The third brightness indicating the brightness between the two brightnesses is set (S79). Note that when the ratio of the R value, G value, and B value of the plurality of pixels in the specific pixel region is not approximately 1: 1: 1, the video corresponding to the video signal is a video video. The video image is a color image. Therefore, the CPU 51 can make the user visually recognize the color video image with appropriate brightness that is not too dark and not too bright by setting the brightness of the image to the third brightness.

  When the state where the number of change pixels is equal to or greater than the second threshold continues for a predetermined time or longer (S101: YES), the CPU 51 turns off the power of the display unit 15 (S103). Thereby, CPU51 can suppress the power consumption of HMD1 without impairing a user's convenience by suppressing that the image | video which does not change is displayed on the display part 15. FIG.

  In addition, this invention is not limited to the said embodiment, A various change is possible. At least one of the area specifying process and the first and second enlargement processes may be executed by the CPU 51. Part or all of the processing executed by the CPU 51 may be executed by the CPU 11 of the HD 10.

  When starting the main process, the CPU 51 may acquire an ID from the diagnostic device and store it in the flash ROM 52. When the specific pixel area is specified by the process of S77, the CPU 51 may store coordinate data indicating the specific pixel area in the flash ROM 52 in association with the ID. The CPU 51 may determine whether the ID acquired from the diagnostic device is stored in the flash ROM 52 when the main process is started next. When the acquired ID is stored in the flash ROM 52, the CPU 51 may acquire coordinate data associated with the ID as coordinate data indicating a specific pixel region. The CPU 51 may cut out the result video 77 from the diagnostic video 76 based on the acquired coordinate data and display it on the display unit 15 of the HD 10. In this case, it is possible to suppress the first ASIC 55 from repeatedly executing the region specifying process, and thus it is possible to further suppress the power consumption of the HMD 1.

  The CPU 51 may be operable in a normal mode or a calibration mode. The CPU 51 may execute the main process when operating in the calibration mode, and may not execute the main process when operating in the normal mode. When the CPU 51 operates in the normal mode and the coordinate data indicating the specific pixel area is stored in the flash ROM 52, the CPU 51 specifies the specific pixel area based on the stored coordinate data, and the diagnostic video 76 The result video 77 may be cut out and displayed on the display unit 15. The user may switch the operation mode of the HMD 1 to the normal mode or the calibration mode by scanning the switch 62.

  In the above embodiment, the CPU 51 determines whether or not the ratio of the R value, the G value, and the B value is approximately 1: 1: 1, so that the video corresponding to the specific pixel area is a black and white video. Judged. The CPU 51 may specify whether or not the image is a black and white image by another method. For example, the CPU 51 may convert the RGB value into a YCrCb value to determine the color variation, and may determine whether the video corresponding to the specific pixel area is a black and white video according to the determination result.

  The first ASIC 55 may execute the area specifying process shown in FIG. 7 instead of the area specifying process shown in FIG. A modification of the area specifying process will be described with reference to FIG. The same processes as those in FIG. 5 are denoted by the same reference numerals and description thereof is omitted. The first ASIC 55 sets the variables P1 to P4, n, A (1), A (2)... A (N) (N is the total number of pixels in the frame) stored in the input buffer 57 to 0. Initialization is performed (S61). Variables A (1), A (2)... A (N) indicate time intervals when any of the R value, G value, and B value of the first to Nth pixels changes. The first ASIC 55 compares the R value, the G value, and the B value of the nth pixel in each image frame based on the X−1 and Xth video data stored in the input buffer 57. (S63). When the first ASIC 55 determines that the R value, the G value, and the B value of the n-th pixel of each image frame match (S63: YES), the first ASIC 55 adds 1 to the variable n (S39). The first ASIC 55 executes the process of S63 again.

  When the first ASIC 55 determines that any one of the R-value, G-value, and B-value of the n-th pixel of each image frame is different (S63: NO), A (n) is larger than a predetermined fourth threshold value. (S65). When the first ASIC 55 determines that A (n) is larger than the fourth threshold (S65: YES), the first ASIC 55 adds 1 to the variable A (n) (S69). The first ASIC 55 adds 1 to the variable n (S39). The CPU 51 executes the process of S63 again. If the first ASIC 55 determines that A (n) is not larger than the fourth threshold (S65: NO), the first ASIC 55 sets A (n) to 0 and initializes it (S67). CPU51 performs the process of S41-S61.

  As described above, even when the first ASIC 55 determines that any one of the R value, the G value, and the B value of the nth pixel of the image frame is different in the region specifying process of the modified example (S63: NO), the A When it is determined that (n) is larger than the predetermined fourth threshold (S65: YES), the variables P1 to P4 indicating the specific pixel area are not updated. The reason is as follows. For example, it is preferable that the date / time video 78A included in the diagnostic video 76 of FIG. However, since the display content of the date / time video 78A is updated at a cycle of 1 second, the date / time video 78A may be determined as the result video 77 when the specific pixel region is specified based on the changed pixel. On the other hand, in the modification, the first ASIC 55 does not determine the portion including the changed pixel as the specific pixel region when the pixel change interval is longer than the predetermined period by the image frame reception cycle. In other words, when the pixel change interval is equal to or shorter than the image frame reception cycle, the first ASIC 55 determines a portion including the changed pixel as the specific pixel region. Accordingly, the first ASIC 55 can suppress the area of the date / time video image 78 </ b> A from being determined as the specific pixel area, and thus can appropriately determine the area specific pixel area of the result video 77.

  The CPU 51 that performs the process of S71 is an example of the “reception unit” in the present invention. The CPU 51 that performs the process of S73 is an example of the “first determination unit” in the present invention. The CPU 51 that performs the process of S78 is an example of the “second determination unit” in the present invention. The CPU 51 that performs the process of S87 is an example of the “third determination unit” in the present invention. The CPU 51 that performs the process of S101 is an example of the “fourth determination unit” in the present invention. The first ASIC 55 is an example of the “specifying means” in the present invention. The CPU 51 that performs the process of S99 is an example of the “first control means” and “second control means” in the present invention. The CPU 51 that performs the process of S103 is an example of the “third control unit” in the present invention.

1 HMD
11 CPU
15 Display unit 51 CPU
55 1st ASIC
56 Second ASIC
76 Diagnosis video 77 Result video 78 Menu video 78A Date and time video

Claims (10)

Receiving means for receiving an image frame every predetermined period;
The number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more among a plurality of pixels constituting the image frame between image frames received every predetermined period is a predetermined number or more First determination means for determining whether or not
When it is determined by the first determination means that the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the R value, the G value, and the B value A specifying means for specifying a specific pixel region including pixels determined to be different from each other by at least a predetermined value;
Second determination means for determining whether the RGB values of the pixels in the specific pixel region satisfy a predetermined condition;
When the second determination means determines that the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, the image corresponding to the specific pixel region is enlarged according to the aspect ratio of the display unit, and First control means for displaying on the display unit ,
The second determination means determines whether the RGB value of the pixel in the specific pixel region is a value representing a black and white video as the predetermined condition,
When the second determination unit determines that the RGB value of the pixel in the specific pixel region is a value representing a monochrome image, the first control unit determines the specific value according to the aspect ratio of the display unit. control device according to claim Rukoto is displayed on the display unit by enlarging the image corresponding to the pixel region. Receiving means for receiving an image frame every predetermined period;
The number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more among a plurality of pixels constituting the image frame between image frames received every predetermined period is a predetermined number or more First determination means for determining whether or not
When it is determined by the first determination means that the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the R value, the G value, and the B value A specifying means for specifying a specific pixel region including pixels determined to be different from each other by at least a predetermined value;
Second determination means for determining whether the RGB values of the pixels in the specific pixel region satisfy a predetermined condition;
When the second determination means determines that the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, the image corresponding to the specific pixel region is enlarged according to the aspect ratio of the display unit, and First control means for displaying on the display unit ,
The second determination means determines whether the ratio of the RGB values of the pixels in the specific pixel region is a value representing a black and white video as the predetermined condition,
When the second determination unit determines that the ratio of the RGB values of the pixels in the specific pixel region is a value representing a black and white image, the first control unit determines whether the ratio of the RGB values of the display unit control device according to claim Rukoto is displayed on the display unit by enlarging the image corresponding to the specific pixel region. The first control means enlarges an image corresponding to the specific pixel area according to an aspect ratio of the display unit of a display device that can be mounted on a head, and displays the enlarged image on the display unit. The control device according to claim 1 or 2 . A head-mounted display comprising the control device according to claim 3 and the display device. The control device includes:
When the second determination means determines that the RGB value of the pixel in the specific pixel area satisfies a predetermined condition, it determines whether the RGB value of the pixel in the specific pixel area is equal to or less than a predetermined value. Third determining means for
When the third determination unit determines that the RGB value of the pixel in the specific pixel area is equal to or less than a predetermined value, the first control unit determines whether the specific pixel corresponds to the aspect ratio of the display unit. The image corresponding to the area is enlarged and displayed on the display unit with the first luminance,
When the third determination means does not determine that the RGB value of the pixel in the specific pixel area is equal to or less than a predetermined value, the first control means determines the specific value according to the aspect ratio of the display unit. an enlarged image corresponding to the pixel region, the control device according to any one of claims 1 to 3, characterized in that to be displayed on the display unit in a bright second luminance than the first luminance. The first control means includes
When it is determined by the second determination means that the RGB value of the pixel in the specific pixel region does not satisfy a predetermined condition, a third luminance that is between the first luminance and the second luminance, The control apparatus according to claim 5 , further comprising second control means for displaying a video corresponding to the image frame on the display unit. When the first determining unit determines that the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the specifying unit The specific pixel region including pixels determined to have at least one of an R value, a G value, and a B value different from each other by a predetermined value or less in a period equal to or less than a reception period. The control device according to any one of claims 3, 5, and 6 . Pixels in which at least one of an R value, a G value, and a B value differs by a predetermined value or more among a plurality of pixels constituting the image frame between image frames received at predetermined intervals by the first determination unit A fourth determining means for determining whether or not a predetermined time or more has elapsed in a state where the number is not greater than or equal to a predetermined number;
Wherein the fourth determining means, the case where it is determined that the elapsed predetermined time, claims 1 to 3, characterized in that it comprises a third control means for turning OFF the power source of the display unit, according to claim 5 control device according to any one of claims 7. A receiving step of receiving an image frame every predetermined period;
The number of pixels in which at least one of the R value, the G value, and the B value is different by a predetermined value or more among the plurality of pixels constituting the image frame between the image frames received every predetermined period by the reception step. A first determination step of determining whether the number is equal to or greater than a predetermined number;
If it is determined in the first determination step that the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the R value, the G value, and the B value A specific step of specifying a specific pixel region including pixels determined to be different from each other by at least a predetermined value;
A second determination step of determining whether RGB values of pixels in the specific pixel region satisfy a predetermined condition;
When it is determined in the second determination step that the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, the image corresponding to the specific pixel region is enlarged according to the aspect ratio of the display unit, Causing the computer to execute a first control step to be displayed on the display unit ;
In the second determination step, as the predetermined condition, it is determined whether the RGB value of the pixel in the specific pixel region is a value representing a black and white image,
When it is determined in the second determination step that the RGB value of the pixel in the specific pixel region is a value representing a black and white video, the first control step is performed according to the aspect ratio of the display unit. A program characterized in that an image corresponding to a pixel area is enlarged and displayed on the display unit . A receiving step of receiving an image frame every predetermined period;
The number of pixels in which at least one of the R value, the G value, and the B value is different by a predetermined value or more among the plurality of pixels constituting the image frame between the image frames received every predetermined period by the reception step. A first determination step of determining whether the number is equal to or greater than a predetermined number;
If it is determined in the first determination step that the number of pixels in which at least one of the R value, the G value, and the B value differs by a predetermined value or more is a predetermined number or more, the R value, the G value, and the B value A specific step of specifying a specific pixel region including pixels determined to be different from each other by at least a predetermined value;
A second determination step of determining whether RGB values of pixels in the specific pixel region satisfy a predetermined condition;
When it is determined in the second determination step that the RGB values of the pixels in the specific pixel region satisfy a predetermined condition, the image corresponding to the specific pixel region is enlarged according to the aspect ratio of the display unit, Causing the computer to execute a first control step to be displayed on the display unit ;
In the second determination step, as the predetermined condition, it is determined whether a ratio of RGB values of pixels in the specific pixel region is a value representing a black and white image,
When it is determined in the second determination step that the ratio of the RGB values of the pixels in the specific pixel region is a value representing a black and white image, the first control step is performed according to the aspect ratio of the display unit. A program characterized in that an image corresponding to the specific pixel region is enlarged and displayed on the display unit .

Images