JP2019060913A - Portable image display device and image display control method - Google Patents

Abstract

To display tally information in an image display device including a compact display without reducing visibility of an image.SOLUTION: An HMD 10 that is a portable image display device comprises a compact display 25, and an image display control unit 15 that performs image display control. The image display control unit 15 performs processing of changing the display modes, such as the size, luminance, and color of an image displayed on the display 25 on the basis of a tally signal acquired from a sub control room 3. Thus, tally information is expressed on the display 25 without erosion of the display area of the original image.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a portable image display device having a small display, and an image display control method for displaying an image on the portable image display device.

  In a television relay broadcasting system that relays broadcast material signals obtained from a plurality of television cameras, an image being photographed by each television camera is displayed on the monitor of the sub control room, and the program production staff is looking at the monitor image while switching the switcher The image to be used for the broadcast is appropriately selected by operating the. A tally signal is output from the switcher to the selected television camera, and the tally lamp attached at the top is turned on on the camera side so that the image being taken by the camera is being used for broadcasting. Are shown to people in and around the staff.

  Nowadays, ENG (Electronic News Gathering) cameras that can be carried on the shoulder are used in most of the shootings that require mobility such as news coverage and sports broadcasts. Such hand-held cameras usually have small sub-monitors. In recent years, use of a portable image display device such as a cellular phone or a head mounted display (HMD) has been considered as such a sub monitor.

  In addition, there is also a need that the cameraman himself wants to know tally information while looking at a photographed image (monitoring image). For example, according to Patent Document 1, images from a plurality of different cameras are allocated to each segment of terrestrial digital area broadcast 1ch and transmitted, and a mobile phone with a reception function is used together with monitoring images of each camera. It has been proposed to display a red tally on the upper part of the image selected with Air.

  However, in general, it is considered difficult to perform multi-window display on a relatively small size display such as a mobile phone from the viewpoint of visibility. Related to this problem, for example, Patent Document 2 displays an icon for activating the shooting function in the foreground on the standby screen of a mobile phone having the shooting function, and displays an icon of a moving image being shot in the background A terminal device is disclosed that does not prevent activation or operation of other functions (applications) by displaying on the screen. Further, for example, Patent Document 3 discloses a virtual sub-tuning device that causes the HMD to display monitoring images being photographed by a plurality of cameras and displays a surrounding of the monitoring image in the on-air with a solid line.

JP 2011-250359 A JP, 2015-57734, A JP 2000-152075 A

  As described above, when the monitoring image and the tally information of the television camera are simultaneously displayed in multiple windows on a relatively small display such as a mobile phone or HMD, the display area of the monitoring image is inevitably eroded and a sufficient display I could not secure the area. Further, although it is conceivable to provide a tally lamp separately from the monitor device, problems remain in the risk of the cameraman overlooking the tally information, the portability of the camera or the mobility such as footwork.

  The present invention has been made in view of such conventional problems, and provides a technique for displaying information such as tally with an image without reducing the visibility of the image displayed on a small display. The purpose is.

  In order to solve the problems described above, the present invention provides an image signal acquisition unit that acquires an image signal, a display that displays an image based on the image signal, and an image display control unit that performs display control of an image displayed on the display And a tally signal acquisition unit for acquiring a tally signal related to the image, wherein the image display control unit displays the image to be displayed on the display based on the acquired tally signal. It is a portable image display device that performs processing to change the display mode.

  The portable image display device is preferably a head mounted display provided with a mounting tool for mounting on the head of a user.

  Preferably, in the portable image display device, the image display control unit performs a process of changing the size of the image based on the tally signal.

  Further, the portable image display device may perform processing of enlarging the size of the image while the image display control unit acquires a tally signal indicating that the image display control unit is in use.

  Further, the portable image display device may perform processing of reducing the size of the image while the image display control unit acquires a tally signal indicating that the image display control unit is not in use.

  Further, in the portable image display device, the image display control unit may perform a process of changing the luminance of the image based on the tally signal.

  Further, in the portable image display device, the image display control unit may perform a process of changing the display mode of the peripheral portion of the image based on the tally signal.

  Further, the portable image display device may perform processing of causing the peripheral portion of the image to blink while the image display control unit acquires a tally signal indicating that the image display control unit is in use.

  Further, in the portable image display device, the image display control unit may perform a process of changing the color of the image based on the tally signal.

  Further, in the portable image display device, the image display control unit may perform processing for changing the color of the peripheral portion of the image based on the tally signal.

  Further, the portable image display device displays the image as a single color on the display while the image display control unit acquires a tally signal indicating that the image display control unit is not in use, and indicates the tally signal indicating that the image is in use. While acquiring, the process of switching the display of the image to a multicolor display may be performed.

  In addition, the portable image display device further includes a detection unit that detects the movement of the display, and the display displays the image by a field sequential method in which each light of RGB is output in time division, and the detection unit Preferably, when the amount of movement of the display detected in the step exceeds a predetermined threshold, the display is switched to another method to display the image.

  Further, the present invention is an image display control method for displaying an image based on an image signal on a portable image display device by arithmetic processing of an image display controller, wherein the arithmetic processing by the image display controller is the image signal. Obtaining a tally signal for the image, displaying the image on the display in a first display mode while indicating that the tally signal is not in use, and using the tally signal Displaying the image on the display in a second display mode different from the first display mode while indicating that the second display mode is the second display mode.

  According to the present invention, the display mode of the image displayed on the display is changed based on the acquired tally signal. Thus, tally information can be displayed on the display together with the image without eroding the display area of the image. Therefore, even if it is a portable image display apparatus provided with a small display, the visibility of an image does not fall and a user can be made to recognize tally information reliably.

FIG. 1 is a block diagram showing an overview of a television relay broadcast system. It is an appearance perspective view of HMD which is an example of a portable type image display. It is a block diagram of the image display control circuit in HMD. It is an output timing chart of the optical signal by FS system. It is an output timing chart of the optical signal by a monochrome display system. It is an output timing chart of the optical signal by a black and white display system. It is an output timing chart of the optical signal by a high rate switching system. It is a flowchart which shows the display mode change process of the image by 1st Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of non-use by 1st Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of use by 1st Example. It is a flowchart which shows the display mode change process of the image by 2nd Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of non-use by 2nd Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of use by 2nd Example. It is a flowchart which shows the display mode change process of the image by 3rd Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of non-use by 3rd Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of use by 3rd Example. It is a flowchart which shows the display mode change process of the image by 4th Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of non-use by 4th Example. It is a figure which illustrates the display mode of the image displayed on a display at the time of use by 4th Example. It is a figure which illustrates the other display aspect of the image displayed on a display at the time of use by 4th Example.

<Overview of Television Relay Broadcasting System>
The portable image display apparatus according to the present invention is provided in addition to a television camera brought into a field where mobility is required for coverage of a sporting event broadcasted on television or a news program. Therefore, first, an example of a television relay broadcasting system for producing a broadcast program on such a site will be described. FIG. 1 shows an outline of a satellite news gathering (SNG) relay broadcasting system as an example.

  In the relay broadcasting system of FIG. 1, program materials (video and audio) acquired by a plurality of television cameras 1, 1,... Are taken into respective CCU (Camera Control Unit) 2, and are converted and encoded, etc. The video and audio signals thus obtained are transmitted to the adjustment device 4 provided in the sub adjustment room (for example, SNG relay vehicle) 3 via the main line system.

  The adjustment device 4 is a complex device in which broadcast editing equipment such as a switcher, a mixer, and a television monitor are incorporated. An image being taken by each television camera 1 is displayed on the monitor of the adjustment device 4 in real time. By switching the switcher while watching the monitor of the adjustment device 4, the staff in the sub adjustment room 3 can select a video and an image to be used for broadcasting in a timely manner. In addition, in the adjustment device 4, moving image effects such as cutting of video signals, dissolves and wipes, mixing of audio signals, etc. can be performed, and editing of a broadcast program is performed in the sub adjustment room 3 provided at the relay site. Almost done. The edited broadcast program material is converted into a TS (Transport Stream) signal of a predetermined digital modulation system in a wireless relay transmission apparatus (FPU: Field Pickup Unit) 5, and the broadcasting station (mainly via a microwave antenna 6) It is transmitted to the coordination room, transmitting station etc.). In addition, a broadcast program edited in the sub adjustment room 3 is recorded on an electronic medium such as the recording device 7 for production and rebroadcast of recorded programs.

  Further, a tally signal is transmitted from the adjustment device 4. Here, the “tally signal” relating to an image is a signal indicating which image (video) taken by which camera is being used for broadcasting by switching of the adjustment device 4. Further, in the present specification, “use” of an image or video means that the image or the like is selected for production of a broadcast program, and the selected image or the like is broadcasted in real time in live broadcasting. In addition to this, it also includes the case of being recorded (recorded) for later broadcast.

  The tally signal transmitted from the adjustment device 4 includes an on-air tally signal indicating that it is currently in use for broadcasting, and a next tally signal indicating that it is to be used next. That is, an on-air tally signal is transmitted to the currently selected television camera 1 (or CCU 2), and a next tally signal is transmitted to the television camera 1 (or CCU 2) to be selected next. On the top of the television camera 1, for example, a red on-air tally lamp and a green next-tally lamp are provided. In this case, when the television camera 1 receives the on-air tally signal from the adjustment device 4, the red tally lamp lights up, and when the next tally signal is received, the green tally lamp lights up. Program performers and production staff can know which camera is being used for broadcasting by turning on the tally lamp.

  In the present specification, the tally signal “indicating that it is in use” basically means the above-mentioned on-air tally signal. Also, a tally signal indicating "not in use" means an inactive signal that is neither the above-described on-air tally signal nor the next tally signal. However, the tally signal indicating “not in use” may be interpreted as including a signal indicating a state other than the on air (for example, a next tally signal).

  In this embodiment, the tally can be displayed on a small display by changing the display mode of the image so that the cameraman gazing at the portable image display device can surely recognize the tally information. did. Therefore, as an example of such a portable or wearable image display apparatus applicable to the present invention, a head mounted display (hereinafter referred to as "HMD") 10 will be described.

<Configuration of HMD (Portable Image Display Device)>
FIG. 2 is a perspective view showing the appearance of the HMD 10. The HMD 10 includes a mounting tool 11, a connector 12, and a display unit 13. A control box (hereinafter referred to as “CB”) 15 is connected to the display unit 13 via a cable 14. The CB 15 is a control device for displaying an image on the display (liquid crystal panel 25) of the display unit 13 based on an image signal input from the outside such as the television camera 1 or an image reproduction player (not shown) via the cable 16. The embodiment may be an embodiment in which the image display control function (details will be described later) included in the CB 15 is integrally incorporated in the display unit 13.

  The mounting tool 11 is an elongated plate-like member that is curved so as to fit the human head, and is made of a metal having a bending elasticity or flexibility, a resin, or a combination thereof. In more detail, the mounting tool 11 includes a curved portion 11a and wide portions 11b and 11c. The curved portion 11a is a portion curved in a U-shape, and the wide portions 11b and 11c are connected to the left and right ends of the curved portion 11a, respectively. The wide portions 11 b and 11 c have shapes curved in the direction in which their respective ends approach each other. The wide portions 11 b and 11 c may be provided with a pad material having flexibility at a portion in contact with the head of the user.

  When a force is applied in a direction in which the left and right wide portions 11b and 11c separate from each other, the mounting tool 11 is elastically deformed so that the entire curved portion 11a mainly opens. In this state, the mounting tool 11 is a user by bringing the inner surface of the curved portion 11a into contact with the forehead of the user and bringing the inner surfaces of the wide portions 11b and 11c into contact with the left and right side heads. Fit on the head of

  A connector 12 is rotatably provided, for example, via a spherical joint 22 having three degrees of freedom on the side of the wide portion 11 c of the mounting tool 11 (the side of the user's left eye). The connector 12 is a rod-like member formed of, for example, a hard resin or the like. A display unit 13 is provided at the tip of the connector 12 similarly via, for example, a spherical joint 23 with three degrees of freedom. With this configuration, the HMD 10 can arrange the display unit 13 in front of the left eye of the user while the mounting tool 11 is mounted on the head of the user.

  The display unit 13 has a hollow box-like housing, and a liquid crystal panel 25 which is a small color display is housed in the housing. The pixel size of the liquid crystal panel 25 is, for example, 1280 × 720 pixels. At the rear end portion of the housing, an opening window (not shown) covered with a transparent plate member is provided to face the display surface of the liquid crystal panel 25. The user wearing the HMD 10 can visually recognize the image displayed by the liquid crystal panel 25 inside the housing through the opening window.

Further, the HMD 10 according to the present embodiment is capable of displaying a color image on the liquid crystal panel 25 by the field sequential method (hereinafter, referred to as “FS method”). The FS method is a color display method using color mixing by time division. That is, in the FS method, each light of red (R), green (G) and blue (B) is sequentially switched for each inter-field cycle to emit light, and the switching speed is temporal resolution of human eyes The RGB color is perceived as mixed in the human eye by setting the speed beyond.
However, in the FS method, it is known that the display phenomenon of color breakup occurs when the display shakes or the like. Color breaking is considered to be generated when images of RGB colors displayed sequentially do not mix well due to factors such as restrictions on the optic nerve of the eye or a sense of image recognition of the human brain. When color breaking occurs, an image of each color of RGB is visually recognized as an afterimage or the like, which may reduce the visibility of the user.
Therefore, in the HMD 10 of the present embodiment, as described later, an output occurs when color breaking may occur, for example, when the amount of movement of the display (movement amount, acceleration, etc.) exceeds a predetermined threshold. By switching the method to another method, measures have been taken to suppress a drop in the visibility of the user.

<Image Display Control Circuit in HMD (Portable Image Display Device)>
FIG. 3 shows a block diagram of an image display control circuit in the HMD 10. As shown in FIG. In the figure, an image signal being captured by the television camera 1 is input to the CCU 2 and CB 15. A monitoring image signal of the television camera 1 is transmitted to the CCU 2 from a switcher or the like in the sub adjustment room 3 via a return system, and the image signal is input to the television camera 1. The image signal input unit 152 of the CB 15 is configured to acquire a digital image signal output from the television camera 1 or a monitoring image signal transmitted via the CCU 2. Alternatively, the CB 15 may be connected to the CCU 2, and the CB 15 may capture an image signal being captured by the television camera 1 or an image signal of a monitoring image sent back from the sub adjustment chamber 3 via the CCU 2. Further, the image signal acquisition unit of the CB 15 may be one capable of acquiring an analog RGB signal or a compojet signal (for example, NTSC, PAL, SCAM, etc.) as an image signal (not shown).

  The image signal acquired by the CCU 2 is decoded into image data by the demodulation unit 155, and image data for each frame is temporarily stored in the frame buffer 157. Also, the CPU 151 acquires the tally signal transmitted from the sub adjustment chamber 3 via the CCU 2. When various control information such as tally is multiplexed with the monitoring image signal transmitted from the sub adjustment chamber 3, the CPU 151 may acquire the tally signal from the data decoded by the demodulator 155.

  The frame processing unit 156 performs image processing on the image data of one frame of the frame buffer 157 under the control of the CPU 151. In the frame processing unit 156, processing such as size change (enlargement / reduction) of an image, movement of a position, or the like is performed so as to specifically fit, for example, the screen size (resolution) or aspect ratio of the liquid crystal panel 25. As described later, the CPU 151 can control the frame processing unit 156 to change the size of the image displayed on the liquid crystal panel 25 based on the acquired tally signal. The frame processing unit 156 can also perform processing such as displaying a plurality of monitoring images and camera control information multiplexed in an image signal in, for example, a multi-window.

  The image data processed by the frame processing unit 156 is separated by the Y / C separation unit 158 into information of luminance (Y) and color (C). The brightness adjustment unit 161 adjusts the brightness to a value adapted to the brightness, contrast, and the like of the liquid crystal panel 25 set in advance. Further, as described later, the CPU 151 can control the luminance adjustment unit 161 and change the luminance of the image based on the acquired tally signal. The color correction unit 162 corrects the color of the image to a preset hue, saturation, and color balance.

  The video signal generation unit 163 D / A converts the adjusted luminance data and color data, and converts the data into an analog compojet signal. The converted and generated image signal is output from the video signal output unit 164 to the display unit 13 via the cable 14. Further, the video signal output unit 164 may output, to the display unit 13, a digital image signal which has been format converted in accordance with, for example, the HDMI (registered trademark) standard.

  Next, in the display unit 13, the image signal is separated into luminance and RGB component color signals by the Y / C separation unit 132. The processing unit (for example, PLD: Programmable Logic Device) 131 controls the RGB output unit 133 to drive the driver 134 by the above-described FS method based on the component color signal, thereby displaying a color image on the liquid crystal panel 25 Do.

  Here, FIG. 4A shows an output timing chart of the vertical synchronization signal (Vsync) and component color signals of R, G, and B according to the FS method. As shown in the figure, in the FS mode, each light of R, G, and B is sequentially switched and output at each switching period T1 between fields, whereby a color image is reproduced on the liquid crystal panel 25. Ru.

  In the HMD 10 of the present embodiment, the light signal to the liquid crystal panel 25 is transmitted when the amount of movement (movement amount, acceleration, angular velocity, etc.) of the liquid crystal panel 25 exceeds a predetermined threshold in order to prevent color breaking. The output method is switched from the FS method to another method.

Specifically, for example, FIG. 4B shows an output timing chart of a color signal according to a single color display method which is an example of another output method. In this method, for example, only G (green) light is output to the liquid crystal panel 25 every field period T2. In this case, all the image signals are converted into green images and displayed on the liquid crystal panel 25.
The HMD 10 can suppress the occurrence of color breaking by displaying an image on the liquid crystal panel 25 in this single-color display mode. This is because color breaking is one of the causes of the timing deviation of the RGB colors sequentially output, whereas in this single-color display mode, there is no timing deviation from the other colors in the first place.

  Further, for example, FIG. 4C shows an output timing chart of a color signal according to a black and white display method which is an example of still another output method. In this method, light of each color of RGB is simultaneously output for each field period T 2, whereby the original color image is converted to a black and white image and displayed on the liquid crystal panel 25. Since RGB light is output synchronously, there is no timing shift of each color, and the occurrence of color breaking can be suppressed for the same reason as that of the above-mentioned single-color display method.

Further, for example, FIG. 4D shows an output timing chart of a color signal according to a high rate switching method which is an example of still another output method. In this method, the switching cycle T3 of each of the RGB color signals is set to be shorter than the switching cycle T1 between fields in the above-described FS system.
According to this high rate switching method, light of each color of RGB is output while being switched in a cycle T3 (for example, half of T1) shorter than the FS method. Therefore, even if the liquid crystal panel 25 moves at a certain speed, the possibility of mixing the colors can be enhanced by the afterimage effect of the eyes of the HMD 10 wearer, and the occurrence of color breaking can be suppressed. Further, as in the FS method, each light of R, G, and B is sequentially switched, so that the original image can be reproduced with high accuracy.

  The display unit 13 of the HMD 10 is provided with a motion detection unit 135 for detecting the amount of motion of the liquid crystal panel 25. As the motion detection unit 135, for example, an appropriate sensor such as an acceleration sensor, a multi-axis gyro sensor, or an IMU (Inertial Measurement Unit) can be adopted.

  As described above, in the HMD 10 according to the present embodiment, a situation in which color breaking is likely to occur, such as when the movement of the display unit 13 is large, is detected, and the display mode of the liquid crystal panel 25 is switched from the FS mode to another mode. Always trying to ensure good visibility.

<Image Processing in HMD (Portable Image Display Device)>
Next, in the HMD 10, some embodiments will be described in which tally is displayed on a small display by changing the display mode of the image based on the acquired tally signal.

(First embodiment)
FIG. 5 is a flowchart showing an image display mode change process according to the first embodiment. First, the CPU 151 acquires an image signal of an image currently being shot which is output from the television camera 1 (S11). Subsequently, the CPU 151 acquires a tally signal transmitted from the adjustment device 4 (S12). If it is determined in step S13 that the tally signal indicates “not in use” (step S13: NO), the CPU 151 controls the frame processing unit 156 to set the size of the target image to the liquid crystal panel 25. A process is performed to reduce the size to a size smaller than the full size (step S14). Thereby, for example, as shown to FIG. 6A, the monitoring image which is not used for broadcast is shrunk | reduced and displayed on the predetermined position of the liquid crystal panel 25 of HMD10.

  On the other hand, if the tally signal indicates “in use” in the determination process of step S13, that is, if it is an on-air tally signal (step S13: YES), the CPU 151 controls the frame processing unit 156 during that time. Then, the process of enlarging the size of the target image to the full size of the liquid crystal panel 25 is performed (step S15). As a result, for example, as shown in FIG. 6B, the on-air image being used for broadcasting is enlarged and displayed on the liquid crystal panel 25 of the HMD 10.

  As described above, in the first embodiment, the CPU 151 which is the image display control unit of the HMD 10 performs the process of changing the size of the image displayed on the liquid crystal panel 25 based on the acquired tally signal. Thus, the cameraman wearing the HMD 10 can recognize the tally information by the size of the image displayed on the liquid crystal panel 25. Further, since the on-air image being used for broadcasting is enlarged and displayed on the HMD 10, the visibility of the photographer wearing the HMD 10 is not reduced.

Second Embodiment
FIG. 7 is a flowchart showing an image display mode change process according to the second embodiment. First, the CPU 151 acquires an image signal of an image currently being shot which is output from the television camera 1 (S21). Subsequently, the CPU 151 acquires a tally signal transmitted from the adjustment device 4 (S22). If it is determined in step S23 that the tally signal indicates "not in use" (step S23: NO), the CPU 151 controls the brightness adjustment unit 161 to relatively lower the brightness of the target image. The image is adjusted to the first luminance, and an image is displayed on the liquid crystal panel 25 (step S24). As a result, for example, as shown in FIG. 8A, the monitoring image which is not used for broadcasting is displayed slightly dark on the HMD 10.

  On the other hand, if the tally signal indicates “in use” in the determination process of step S23, that is, if it is an on-air tally signal (step S23: YES), the CPU 151 controls the luminance adjustment unit 161 during that time. The brightness of the target image is adjusted to a relatively high second brightness (> first brightness), and the image is displayed on the liquid crystal panel 25 (step S25). As a result, for example, as shown in FIG. 8B, the on-air image being used for broadcasting is brightly displayed on the liquid crystal panel 25 of the HMD 10.

  As described above, in the second embodiment, the CPU 151 which is the image display control unit of the HMD 10 performs the process of changing the luminance of the image displayed on the liquid crystal panel 25 based on the acquired tally signal. Thus, the cameraman wearing the HMD 10 can recognize the tally information by the brightness of the image displayed on the liquid crystal panel 25. Further, since the on-air image being used for broadcasting is displayed brightly on the HMD 10, the visibility of the photographer wearing the HMD 10 is not reduced. In addition, by reducing the luminance when not in use, the total power consumption of the HMD 10 can be suppressed. Therefore, the battery drive time of the HMD 10 can be extended.

Third Embodiment
FIG. 9 is a flowchart showing an image display mode change process according to the third embodiment. First, the CPU 151 acquires an image signal of an image currently being shot which is output from the television camera 1 (S31). Subsequently, the CPU 151 acquires a tally signal transmitted from the adjustment device 4 (S32). If it is determined in step S33 that the tally signal indicates "not in use" (step S33: NO), the CPU 151 controls the color correction unit 162 to display a monochrome image on the liquid crystal panel 25. It displays (step S34). As a result, for example, as shown in FIG. 10A, a monitoring image not used for broadcasting is displayed on the HMD 10 in monochrome.

  On the other hand, if the tally signal indicates “in use” in the determination process of step S33, that is, if it is an on-air tally signal (step S33: YES), the CPU 151 is shown in FIG. The color image is displayed on the liquid crystal panel 25 (step S35).

  As described above, in the third embodiment, the CPU 151 which is the image display control unit of the HMD 10 performs the process of changing the color of the image displayed on the liquid crystal panel 25 based on the acquired tally signal. As a result, the photographer wearing the HMD 10 can recognize the tally information by the color of the image displayed on the liquid crystal panel 25. In addition, if the image being used for broadcasting is displayed in color on the HMD 10, good visibility of the on-air image can be maintained. Also, by displaying in monochrome when not in use, the total power consumption of the HMD 10 can be suppressed. Therefore, the battery drive time of the HMD 10 can be extended.

Fourth Embodiment
FIG. 11 is a flowchart showing an image display mode change process according to the fourth embodiment. First, the CPU 151 acquires an image signal of an image currently being shot which is output from the television camera 1 (S41). Subsequently, the CPU 151 acquires a tally signal transmitted from the adjustment device 4 (S42). In the determination process of step S43, when the tally signal indicates “not in use” (step S43: NO), the CPU 151 directly displays the image based on the acquired image signal as it is as shown in FIG. 12A. 25 is displayed (step S44).

  On the other hand, if the tally signal indicates “in use” in the determination processing of step S43, that is, if it is an on-air tally signal (step S43: YES), the CPU 151 controls the frame processing unit 156 during that time. Then, image processing is performed to superpose a band-like frame on the periphery of the target image (step S45). Thus, for example, an on-air image surrounded by a band-like frame as shown in FIG. 12B is displayed on the liquid crystal panel 25 of the HMD 10.

As a modification of the fourth embodiment, only the display mode of a part of the image peripheral portion may be changed. For example, as shown in FIG. 13, a band may be superimposed on the upper end portion of the on-air image, and it may be displayed that the on-air is on with a telop or the like as a background. Further, the tally may be recognized by blinking a band or a band-like frame at the periphery of the image. Furthermore, the tally may be exposed by changing the color of the peripheral portion of the image between in-use and non-in-use.
Note that by displaying a band or a band-like frame superimposed on the periphery of the on-air image in a see-through manner, the image of the periphery may be seen through the band.

  As described above, in the fourth embodiment, the CPU 151 which is the image display control unit of the HMD 10 performs the image processing for changing the display mode of the peripheral portion of the on-air image while acquiring the tally signal indicating that it is in use. I did it. Thus, the cameraman wearing the HMD 10 can recognize the tally information based on the presence or absence of a band or a band-like frame superimposed on the image. In addition, the visibility of the on-air image is not reduced.

  According to the plurality of embodiments and modifications described above, the tally information is displayed together with the original image by changing the display mode of the image based on the acquired tally signal. As a result, even in the case of the HMD 10 which is a small display, the user (photographer) can reliably recognize the tally information without eroding the display area of the original image.

  In addition, the display mode of the image changed based on the tally signal is not limited to the plurality of examples and modifications described above. However, tally information may be displayed on the display by combining two or more of these display mode changes. In addition, the display mode of the image may be changed to different ones when the on-air tally signal is acquired and when the next tally signal is acquired. In addition, information other than tally (for example, in an emergency alert or during a commercial) may be displayed on the display by changing the display mode of the image.

  Further, the mounting tool for the HMD is not limited to the above-described configuration, and may have a configuration such as an attachment mounted on a hat, a helmet, or the like, or may have a configuration such as a frame of glasses. As described above, in the HMD mounted on the head of the user, the display unit is also miniaturized from the viewpoint of the mountability, and the display area also tends to be reduced. However, according to the present invention, even with such an HMD, tally information can be surely recognized by the user without lowering the visibility of the image. Furthermore, the present invention can be applied not only to the above-described HMD, but also to portable or wearable general purpose displays such as mobile phones and small liquid crystal monitors.

1 Television camera 2 Camera control unit (CCU)
3 Sub adjustment room 4 Adjustment device 10 Head mounted display (HMD)
11 mounting tool 12 connecting tool 13 display unit 14 cable 15 control box (CB)
25 LCD panel (display)
131 processing unit (PLD)
132 Y / C separation unit 133 RGB output unit 134 driver 135 motion detection unit 151 CPU
152 image signal input unit 155 demodulation unit 156 frame processing unit 157 frame buffer 158 Y / C separation unit 161 luminance adjustment unit 162 color correction unit 163 video signal generation unit 164 video signal output unit

Claims (13)

An image signal acquisition unit that acquires an image signal, a display that displays an image based on the image signal, an image display control unit that controls display of an image displayed on the display, and a tally signal that acquires a tally signal related to the image A portable image display device including an acquisition unit;
The portable image display apparatus, wherein the image display control unit performs processing of changing a display mode of the image displayed on the display based on the acquired tally signal.   The portable image display device according to claim 1, which is a head mounted display provided with a mounting tool for mounting on a head of a user.   The portable image display device according to claim 1, wherein the image display control unit performs a process of changing the size of the image based on the tally signal.   The portable image display device according to any one of claims 1 to 3, wherein the image display control unit performs a process of enlarging the size of the image while acquiring a tally signal indicating that the image display control unit is in use.   The portable image display apparatus according to any one of claims 1 to 4, wherein the process of reducing the size of the image is performed while the image display control unit acquires a tally signal indicating that the image display control unit is not in use.   The portable image display apparatus according to any one of claims 1 to 5, wherein the image display control unit performs a process of changing the luminance of the image based on the tally signal.   The portable image display apparatus according to any one of claims 1 to 6, wherein the image display control unit performs a process of changing the display mode of the peripheral portion of the image based on the tally signal.   8. The portable image display device according to claim 7, wherein while the image display control unit acquires a tally signal indicating that it is in use, the image display control unit blinks a peripheral portion of the image.   The portable image display apparatus according to any one of claims 1 to 8, wherein the image display control unit performs a process of changing the color of the image based on the tally signal.   The portable image display device according to claim 9, wherein the image display control unit performs a process of changing a color of a peripheral portion of the image based on the tally signal.   While the image display control unit acquires a tally signal indicating that it is not in use, it displays the image in a single color on the display, and while acquiring a tally signal indicating that it is in use, displaying the image is performed. The portable image display device according to any one of claims 1 to 10, which performs processing of switching to multi-color display. And a detection unit that detects the movement of the display.
When the display displays the image in a field sequential method of outputting each light of RGB in a time division manner, and the amount of movement of the display detected by the detection unit exceeds a predetermined threshold, another method is used. The portable image display device according to any one of claims 1 to 8, which is configured to switch and display the image. An image display control method for displaying an image based on an image signal on a portable image display device by arithmetic processing of an image display control unit, comprising:
Arithmetic processing by the image display control unit is
Acquiring the image signal;
Obtaining a tally signal for the image;
Displaying the image on the display in a first display mode while the tally signal indicates that it is not in use;
Displaying the image on the display in a second display mode different from the first display mode while the tally signal indicates use.