JP2019029742A - Image display device, image display system, and method for controlling image display device - Google Patents

Abstract

To provide an image display device, an image display system, and a method for controlling an image display device with which images can be easily switched.SOLUTION: An image display device comprises: a radio communication unit that is wirelessly connected to both a first computer 1a displaying a display image IM1a and a second computer 1b displaying a display image IM1b, and receives image information and information on the coordinates of an indicated position from at least one of the first computer 1a and second computer 1b; an image projection unit that displays at least one of the display image IM1a and display image IM1b on the basis of the received image information; and a control unit that switches the image displayed by the image projection unit from the display image IM1a to the display image IM1b on the basis of the received coordinate information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display device that displays an image transmitted from a terminal device connected wirelessly, an image display system, and a control method for the image display device.

  In a system including a terminal device (information processing device) and an image display device (display control device), a technique has been proposed in which an image displayed on the terminal device is transferred to the image display device by wireless communication and displayed (see FIG. For example, see Patent Document 1).

Japanese Patent Laid-Open No. 2006-9023

  In the image display device as described above, in order to display an image displayed on a terminal device different from the currently connected terminal device, it is necessary to switch the terminal device to be connected. Specifically, it is necessary to perform a new wireless connection process with another terminal device instead of the terminal device connected so far. For this reason, it takes time and effort to switch the terminal device, and the convenience for the user is impaired.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 An image display device according to this application example is wirelessly connected to both a first terminal device that displays a first image and a second terminal device that displays a second image. Based on at least one of the first terminal device and the second terminal device, a wireless communication unit that receives image information and coordinate information of an indicated position, and the image information received by the wireless communication unit, Based on the coordinate information received by the display unit that displays at least one of the first image and the second image and the wireless communication unit, the image displayed by the display unit is changed from the first image to the first image. And a control unit that switches to an image including the second image.

  According to this image display device, the wireless communication unit wirelessly connects to both the first terminal device and the second terminal device, and from at least one of these terminal devices, image information and coordinate information of the indicated position. And receive. And since a control part switches the image which a display part displays based on the received coordinate information, it becomes possible to switch an image easily. Furthermore, since the image display device is already wirelessly connected to both the first terminal device and the second terminal device when the image is switched, the image display device is reconnected to the new terminal device when the image is switched. Compared to the case, the time required for switching can be shortened, and the convenience for the user is improved.

  Application Example 2 In the image display device according to the application example described above, the control unit changes the image displayed on the display unit from the first image to the first image based on the coordinate information received by the wireless communication unit. It is desirable to switch to the second image.

  According to this image display device, it is possible to easily switch from the first image to the second image.

  Application Example 3 In the image display device according to the application example described above, the control unit switches the image displayed on the display unit from the first image to an image including the second image. It is desirable to stop the terminal apparatus from transmitting the image information.

  According to this image display device, the control unit stops transmission of image information from the first terminal device at the time of switching images, and thus it is possible to suppress unnecessary communication.

  Application Example 4 In the image display device according to the application example described above, the control unit determines, based on the coordinate information received by the wireless communication unit, an image displayed by the display unit from the first image. You may make it switch to the 3rd image containing the said 1st image and the said 2nd image.

  According to this image display device, it is possible to easily switch from a state in which only the first image is displayed to a state in which the third image including both the first image and the second image is displayed. It becomes.

  Application Example 5 In the image display device according to the application example described above, the control unit switches the second image when the image displayed on the display unit is switched from the first image to the image including the second image. It is desirable to cause the terminal device to start transmitting the image information.

  According to this image display device, the control unit can stop transmission of image information from the second terminal device until the image is switched, so that unnecessary communication can be suppressed. .

  Application Example 6 In the image display device according to the application example, the control unit displays the display unit when the indicated position based on the coordinate information received by the wireless communication unit is within a predetermined range. It is desirable to switch images.

  According to this image display device, it is possible to easily switch images only by positioning the designated position within a predetermined range.

  Application Example 7 In the image display device according to the application example described above, the control unit has passed a predetermined time after the indicated position based on the coordinate information received by the wireless communication unit is within the predetermined range. In this case, it is desirable to switch the image displayed on the display unit.

  According to this image display device, since the control unit switches the image when a predetermined time has elapsed since the designated position is located within the predetermined range, the image is unintentionally switched due to an erroneous operation or the like. Can be suppressed.

  Application Example 8 In the image display device according to the application example, in the control unit, the wireless communication unit receives image information corresponding to the first image and the coordinate information from the first terminal device. In this case, it is desirable to adjust the size of the predetermined range based on the size of the first image.

  According to this image display device, since the control unit adjusts the size of the predetermined range based on the size of the first image, the size of the predetermined range is set to an appropriate size according to the size of the first image. It becomes possible to.

  Application Example 9 In the image display device according to the application example described above, the control unit is configured such that the indicated position based on the coordinate information received by the wireless communication unit is located in a predetermined order within a plurality of preset ranges. In this case, the image displayed on the display unit may be switched.

  According to this image display device, the control unit switches the image when the designated position is positioned in a predetermined order in a plurality of ranges, so that it is possible to prevent the image from being switched unintentionally due to an erroneous operation or the like. It becomes possible.

  Application Example 10 In the image display device according to the application example described above, the control unit displays the display when the locus of the indicated position based on the coordinate information received by the wireless communication unit is a predetermined figure. You may make it switch the image to perform.

  According to this image display device, since the control unit switches the image when the locus of the designated position is a predetermined figure, it is possible to prevent the image from being unintentionally switched due to an erroneous operation or the like. .

  Application Example 11 In the image display device according to the application example, the control unit displays a selection screen for selecting an image to be displayed on the display unit based on the coordinate information received by the wireless communication unit. You may make it display on a display part.

  According to this image display device, since the control unit displays the selection screen for selecting an image on the display unit, switching to a desired image is facilitated.

  Application Example 12 An image display system according to this application example includes a first terminal device that displays a first image, a second terminal device that displays a second image, and an image display device. An image display system, wherein the image display device is wirelessly connected to both the first terminal device and the second terminal device, and at least one of the first terminal device and the second terminal device. And displaying at least one of the first image and the second image based on the image information received by the wireless communication unit, the wireless communication unit receiving the image information and the coordinate information of the indicated position And a control unit that switches an image displayed on the display unit from the first image to an image including the second image based on the coordinate information received by the wireless communication unit. It is characterized by that.

  According to this image display system, the wireless communication unit of the image display device is wirelessly connected to both the first terminal device and the second terminal device, and image information and instructions are transmitted from at least one of these terminal devices. The coordinate information of the position is received. And since the control part of an image display apparatus switches the image which a display part displays based on the received coordinate information, it becomes possible to switch an image easily. Furthermore, since the image display device is wirelessly connected in advance to both the first terminal device and the second terminal device, switching is required compared to the case of reconnecting to a new terminal device at the time of switching. Time can be shortened and user convenience is improved.

  Application Example 13 The image display device control method according to this application example is wirelessly connected to both the first terminal device that displays the first image and the second terminal device that displays the second image. And receiving image information and coordinate information of the indicated position from at least one of the first terminal device and the second terminal device, and based on the received image information, the first image and the Displaying at least one of the second images on a display unit, and switching an image displayed on the display unit from the first image to an image including the second image based on the received coordinate information. It is characterized by.

  According to this method for controlling an image display device, the image display device is wirelessly connected to both the first terminal device and the second terminal device, and image information and an indicated position are received from at least one of these terminal devices. And receive coordinate information. And since the image display apparatus switches the image which a display part displays based on the received coordinate information, it becomes possible to switch an image easily. Furthermore, since the image display device is wirelessly connected in advance to both the first terminal device and the second terminal device, switching is required compared to the case of reconnecting to a new terminal device at the time of switching. Time can be shortened and user convenience is improved.

Explanatory drawing which shows an image display system. The block diagram which shows schematic structure of a computer. 1 is a block diagram showing a schematic configuration of a projector. The flowchart for demonstrating operation | movement of the projector at the time of performing mirroring of a computer. The flowchart for demonstrating operation | movement of the projector at the time of performing mirroring of a computer. The figure which shows a selection screen. Explanatory drawing which shows a mode that a pointer moves between several detection ranges. Explanatory drawing which shows a mode that a pointer moves so that a predetermined locus | trajectory may be drawn. The figure which shows the state in which a projector displays only the display image of a 1st computer. The figure which shows the state in which a projector displays both the display image of a 1st computer, and the display image of a 2nd computer. The figure which shows the state in which a projector displays only the display image of a 2nd computer.

Hereinafter, the image display system 100 of the present embodiment will be described with reference to the drawings.
FIG. 1 is an explanatory diagram showing an image display system 100 according to the present embodiment.
As shown in FIG. 1, the image display system 100 includes two computers 1 (also referred to as a first computer 1a and a second computer 1b) as terminal devices, and a projector 2 as an image display device. ing. The two computers 1 are, for example, notebook personal computers, and integrally configured with a display unit 12 that displays an image, a keyboard 16 that is an input device, and a touch pad 17 that is a pointing device. . The computer 1 is also connected with a mouse 18 that is an external pointing device. The projector 2 receives image information supplied from at least one computer 1 and projects an image corresponding to the image information onto a projection object such as a screen SC or a wall surface (hereinafter also simply referred to as a screen SC). The computer 1 and the projector 2 are connected by a wireless local area network (LAN), and image information and the like are supplied from the computer 1 to the projector 2 wirelessly.

  In this embodiment, the computer 1 and the projector 2 correspond to Miracast (registered trademark). Miracast is a communication standard for transmitting data streams such as images and sounds using Wi-Fi Direct (registered trademark) that enables P2P (Peer to Peer) type wireless connection as a communication path. As a data stream transmission protocol in Miracast, RTP (Real time Transport Protocol) operating on UDP (User Datagram Protocol) is used, and as a protocol for controlling transmission, RTSP operating on TCP (Transmission Control Protocol). (Real Time Streaming Protocol) is used. By transmitting the image from the computer 1 to the projector 2 by this Miracast, the image displayed on the display unit 12 of the computer 1 can also be displayed by the projector 2. Displaying the same image as that displayed by another device in this way is called “mirroring”. That is, when the projector 2 mirrors one computer 1 by Miracast, the image (display image IM2) projected by the projector 2 is the same as the image (display image IM1) displayed on the display unit 12 of the computer 1. Become. Of the devices that communicate by Miracast, the device that transmits the image (for example, the computer 1) is also referred to as “source”, and the device that receives and displays the image (for example, the projector 2) is the “source”. , Also called “sink”.

FIG. 2 is a block diagram illustrating a schematic configuration of the computer 1. Since the two computers 1 have a common configuration, the illustration of the configuration of one computer 1 (second computer 1b) is omitted.
As shown in FIG. 2, the computer 1 includes a control unit 10, a storage unit 11, a display unit 12, a display control unit 13, an image / audio processing unit 14, a wireless communication unit 15, a keyboard 16, and a touch. And a pad 17. Among these, the storage unit 11, the display control unit 13, the audio / video processing unit 14, the wireless communication unit 15, the keyboard 16, and the touch pad 17 are connected to the control unit 10. The control unit 10 is connected to a mouse 18 that is an external pointing device.

  The control unit 10 includes one or more processors, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The control unit 10 performs overall control of the operation of the computer 1 by operating according to a program stored in the ROM or a program read from the storage unit 11 to the RAM.

  The storage unit 11 includes a storage device such as a hard disk drive or a solid state drive. The storage unit 11 stores an installed OS (Operating System), application programs, various data, and the like. Windows (registered trademark) 10 is installed as an OS in the storage unit 11 of the present embodiment, and the control unit 10 performs control according to Windows 10 and an application program corresponding thereto.

  The display unit 12 includes a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display, and displays an image based on image information.

  The display control unit 13 is configured by one or a plurality of processors and the like, and controls display of an image by the display unit 12 based on the control of the control unit 10. The display control unit 13 is connected to a VRAM (Video RAM) (not shown), and stores image information in accordance with the OS, application programs, various data, and the like in the VRAM based on the control of the control unit 10. An image based on the information is displayed on the display unit 12. The display control unit 13 may be configured by a dedicated processing device such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  Based on the control of the control unit 10, the image / sound processing unit 14 performs predetermined processing on an image and sound transmitted by Miracast. Specifically, the audio / video processing unit 14 acquires image information corresponding to the display image IM1 of the display unit 12 from the display control unit 13, and is a moving image encoding standard used in Miracast. The image information is encoded (compressed) according to H.264. The audio / video processing unit 14 encodes audio information corresponding to the audio accompanying the image using LPCM, AAC, or AC3, which is an audio encoding standard used in Miracast. The image and sound processing unit 14 transmits the processed image information and sound information to the projector 2 via the wireless communication unit 15. The audio / video processing unit 14 may be configured by one or a plurality of processors or the like, or may be configured by a dedicated processing device such as an ASIC or an FPGA.

  The wireless communication unit 15 includes a wireless LAN device that performs communication via a wireless LAN, and performs wireless communication with an external device such as the projector 2 based on the control of the control unit 10. When performing mirroring by Miracast, the wireless communication unit 15 performs Miracast connection with the projector 2 that is a sink based on the control of the control unit 10, and transmits image information and audio information to the projector 2 by RTP. In addition, when the wireless communication unit 15 receives control information (message) from the projector 2 by RTSP, the wireless communication unit 15 outputs the received control information to the control unit 10.

  The keyboard 16 is an input device that receives input of characters, control codes, and the like by key operations. The touch pad 17 and the mouse 18 are pointing devices that accept input operations such as a movement operation, a click operation, and a drag operation of the pointer PT1 that indicates a position on the display image IM1. The keyboard 16, the touch pad 17, and the mouse 18 transmit an operation signal based on an operation performed by the user to the control unit 10. Note that when the touch pad 17 is used as a pointing device, it is not necessary to connect the mouse 18. Further, when the mouse 18 is used as a pointing device, it is not necessary to use the touch pad 17.

  Windows 10 which is the OS of the computer 1 transmits the coordinate information of the pointing position indicated by the pointing device (touch pad 17 or mouse 18), that is, the coordinate information of the pointer PT1, along with the transmission of the image information and the audio information by Miracast. It has a function (Hardware Cursor Extension) for repeatedly transmitting to the projector 2 as a sink. This function is provided to prevent the display of the pointer PT2 from being delayed due to image transmission by causing the sink to draw the pointer PT2 displayed by the sink. When both the computer 1 and the projector 2 support this function, the computer 1 transmits the coordinate information of the pointer PT1 while transmitting image information not including the pointer PT1, and the projector 2 adds the received image information to the received image information. The pointer PT2 is drawn at a position based on the received coordinate information on the base image. Note that the coordinate information is information indicating the indicated position in the display image IM1, that is, the position (coordinate) of the pointer PT1, for example, the coordinate in the horizontal direction (X direction) with the upper left corner of the display image IM1 as the origin, and This is information representing the coordinates in the vertical direction (Y direction) in units of pixels.

  The control unit 10 transmits coordinate information to the projector 2 via the wireless communication unit 15. At this time, the control part 10 transmits coordinate information as a data stream different from image information and audio | voice information using UDP. In addition, the control part 10 can also transmit the form information of pointer PT1 with the coordinate information of pointer PT1. The form information is, for example, image data representing the shape and color of the pointer PT1. As a result, the projector 2 can reproduce various types of pointers PT1 displayed on the display unit 12 of the computer 1 as the pointer PT2 on the display image IM2 displayed by the projector 2, and the shape of the pointers PT1 can be changed over time. A pointer PT1 that changes can also be reproduced.

Next, the configuration of the projector 2 will be described.
FIG. 3 is a block diagram illustrating a schematic configuration of the projector 2.
As shown in FIG. 3, the projector 2 includes a control unit 20, a storage unit 21, an input operation unit 22, a wireless communication unit 23, an image / audio processing unit 24, an image projection unit 25, and an audio output unit 26. It is comprised including. Among these, the storage unit 21, the input operation unit 22, the wireless communication unit 23, and the audio / video processing unit 24 are connected to the control unit 20.

  The control unit 20 includes one or a plurality of processors, and performs overall control of the operation of the projector 2 by operating according to a control program stored in the storage unit 21.

  The storage unit 21 includes a RAM that is a volatile memory and a ROM that is a nonvolatile memory. The RAM is used for temporary storage of various data and the like, and the ROM stores a control program and control data for controlling the operation of the projector 2. In addition, the storage unit 21 of the present embodiment stores a connection source list 21a used when the projector 2 performs Miracast connection with a source such as the computer 1 or the like. In the connection source list 21a, identification information (for example, device name, IP address, etc.) that can identify the connected source is registered and stored. When the projector 2 is connected to a plurality of sources, the connection source list 21a stores the identification information of the plurality of connected sources so that the connection order can be known.

  The input operation unit 22 includes a plurality of operation keys for a user to give various instructions to the projector 2. The operation keys of the input operation unit 22 include a “power key” for switching the power on and off, a “menu key” for displaying a setting menu for performing various settings, and an item for the setting menu. There are “direction keys”. When the user operates various operation keys of the input operation unit 22, the input operation unit 22 outputs an operation signal corresponding to the operation content of the user to the control unit 20. A remote control (not shown) capable of remote operation may be used as the input operation unit 22. In this case, the remote control transmits an infrared operation signal corresponding to the user's operation content, and a remote control signal receiving unit (not shown) receives this and transmits it to the control unit 20.

  The wireless communication unit 23 includes a wireless LAN device that performs communication using a wireless LAN, and performs wireless communication with an external device such as the computer 1 based on the control of the control unit 20. As described above, the projector 2 corresponds to Miracast, and can perform mirroring in which the projector 2 displays the display image IM1 displayed by the computer 1. In this case, the wireless communication unit 23 performs Miracast connection with the computer 1 based on the control of the control unit 20, and receives image information, audio information, and coordinate information from the computer 1. The wireless communication unit 23 outputs the received image information and audio information to the image / audio processing unit 24, and outputs the received coordinate information to the control unit 20. In addition, the wireless communication unit 23 can transmit control information (message) to a source such as the computer 1 by RTSP based on the control of the control unit 20.

  The image sound processing unit 24 decodes image information and sound information transmitted by Miracast, and performs various processes such as adjustment processing on the decoded image information and sound information based on the control of the control unit 20. The image audio processing unit 24 performs processing on the image information, such as processing for adjusting image quality, processing for superimposing the pointer PT2 on the position based on the coordinate information input from the computer 1, or superimposing a menu image or the like as necessary. There is processing to do. Further, the processing performed on the audio information by the audio / video processing unit 24 includes processing for adjusting sound quality and volume. The image sound processing unit 24 outputs the processed image information to the image projection unit 25 and outputs the processed sound information to the sound output unit 26. The audio / video processing unit 24 may be configured by one or a plurality of processors or the like, or may be configured by a dedicated processing device such as an ASIC or an FPGA.

  The image projection unit 25 includes a light source 31, three liquid crystal light valves 32R, 32G, and 32B as light modulation devices, a projection lens 33 as a projection optical system, a light valve drive unit 34, and the like. The image projection unit 25 corresponds to a display unit, and modulates the light emitted from the light source 31 by the liquid crystal light valves 32R, 32G, and 32B to form image light. The image light is transmitted from the projection lens 33. Project and display an image on the screen SC.

  The light source 31 includes a discharge type light source lamp such as an ultra-high pressure mercury lamp or a metal halide lamp, or a solid light source such as a light emitting diode or a semiconductor laser. Light emitted from the light source 31 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and red (R), green (G), and blue that are the three primary colors of light by a color separation optical system (not shown). After being separated into each color light component of (B), it enters the liquid crystal light valves 32R, 32G, 32B, respectively.

  The liquid crystal light valves 32R, 32G, and 32B are each configured by a transmissive liquid crystal panel (not shown) in which liquid crystal is sealed between a pair of transparent substrates. Each liquid crystal panel is formed with a plurality of pixels arranged in a matrix, and a driving voltage can be applied to the liquid crystal for each pixel.

  The light valve drive unit 34 applies a drive voltage corresponding to the image information input from the image sound processing unit 24 to each pixel, and sets each pixel to a light transmittance corresponding to the image information. Light emitted from the light source 31 is modulated by passing through the liquid crystal light valves 32R, 32G, and 32B, and image light corresponding to image information is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesis optical system (not shown) to form image light representing a color image, and is enlarged and projected on the screen SC by the projection lens 33. As a result, the image based on the image information transmitted from the computer 1, that is, the same image as the display image IM1 displayed on the display unit 12 of the computer 1 is displayed on the screen SC as the display image IM2 (FIG. 1). reference).

  The audio output unit 26 includes a speaker or the like, and outputs audio based on the audio information input from the image / audio processing unit 24.

Next, the operation of the image display system 100 will be described.
4 and 5 are flowcharts for explaining the operation (control method) of the projector 2 when mirroring the computer 1.
When the user operates the input operation unit 22 of the projector 2 to instruct to start mirroring, the control unit 20 of the projector 2 starts an operation according to a control program for performing mirroring. Hereinafter, image information, audio information, and coordinate information transmitted from the source computer 1 to the projector 2 are collectively referred to as “image information or the like”.

  As shown in FIG. 4, in step S101, the control unit 20 enables an Autonomous GO (Group Owner) function of Wi-Fi Direct. In Wi-Fi Direct serving as a Miracast communication path, one of a plurality of devices is GO, and the other devices are GC (Group Client). The GO enables direct connection between the GO and the GC by realizing the function of the access point of the wireless LAN by software. Normally, which of a plurality of devices will be GO is determined through negotiation between the devices. However, when the projector 2 enables the Autonomous GO function, the projector 2 becomes GO without negotiation. It is determined. That is, in the present embodiment, the projector 2 that is the sink is GO, and the computer 1 that is the source is GC.

  In step S102, the control unit 20 determines whether or not a Miracast connection is requested from any source. When there is a request for Miracast connection from the source, the control unit 20 moves the process to step S103, and when there is no request, moves the process to step S107. Note that the Miracast connection request to the projector 2 is made, for example, when the user operates the computer 1.

  When there is a request for Miracast connection from the source and the process proceeds to step S103, the control unit 20 performs a Miracast connection with the requested source. And the control part 20 acquires identification information from this source, and registers it in the connection source list | wrist 21a.

  In step S104, the control unit 20 refers to the connection source list 21a and determines whether or not a source other than the currently connected source is already connected. When the source connected this time is the first (first) source, the control unit 20 moves the process to step S105, and when already connected to another source, moves the process to step S108.

  When the source connected this time is the first source and the process proceeds to step S105, the control unit 20 transmits a PLAY message by RTSP to the source connected this time. The PLAY message is control information for instructing the start of transmission of image information or the like, and the source that has received this becomes a mirroring target and starts transmission of image information or the like.

  In step S106, the control unit 20 starts mirroring based on image information transmitted from the source. As a result, the projector 2 projects an image corresponding to the image information transmitted from the source and outputs a sound corresponding to the audio information transmitted from the source. That is, in steps S105 and S106, the control unit 20 causes the image projection unit 25 to display the first connected source display image IM1.

  In step S107, the control unit 20 determines whether or not the user has instructed the end of mirroring by operating the input operation unit 22 or the like. The control unit 20 returns the process to step S102 when the end of mirroring is not instructed, and performs the necessary end process when the end of mirroring is instructed, and ends the flow.

  On the other hand, if it is already connected to another source in step S104 and the process proceeds to step S108, that is, if the source connected this time is the second source, the control unit 20 connected this time. A PAUSE message is transmitted to the source by RTSP. The PAUSE message is control information that suppresses transmission of image information and the like, and the source that has received the PAUSE message stops if it is transmitting image information or the like, and waits in that state if it is not transmitting. When two sources are Miracast connected to the projector 2 in this way, the control unit 20 advances the processing to step S111 (see FIG. 5).

  As shown in FIG. 5, in step S111, the control unit 20 determines whether the pointing position by the pointing device, that is, the position of the pointer PT1 is within a predetermined range based on the coordinate information transmitted from the mirroring target source. Judge whether or not. For example, a rectangular range in the upper left corner of the display image IM1 (for example, a range of 0 to 100 pixels for both the X coordinate and the Y coordinate) is set in advance as the detection range Rd (see FIG. 1). It is determined whether or not the position is within the detection range Rd. If the position of the pointer PT1 is within the detection range Rd, the process proceeds to step S112. If the position is not within the detection range Rd, the process proceeds to step S114.

  When the position of the pointer PT1 is within the detection range Rd and the process proceeds to step S112, the control unit 20 performs source switching. Specifically, the control unit 20 transmits a PAUSE message by RTSP to a source that transmits image information or the like, that is, a source that has been a mirroring target so far, and stops transmission of image information or the like. Let Next, the control unit 20 refers to the connection source list 21a, determines the next source in the connection order as a new mirroring target, and transmits a PLAY message to this source by RTSP. And the source which received this starts transmission of image information etc. When the source is switched while the last source is mirrored in the connection order, the control unit 20 sets the source with the first connection order as a new mirroring target.

  In step S113, the control unit 20 starts mirroring based on image information or the like transmitted from a source that has been newly mirrored. As a result, the projector 2 projects an image corresponding to the image information transmitted from the source, and outputs sound corresponding to the audio information transmitted from the source. In other words, in steps S112 and S113, the control unit 20 displays the image to be displayed on the image projection unit 25 from the source display image IM1 that has been the object of mirroring until now, and the source display image that has been newly mirrored. Switch to IM1.

  In step S114, the control unit 20 determines whether or not a Miracast connection is requested from another source (the third and subsequent sources). If there is a Miracast connection request from the source, the control unit 20 proceeds to step S115, and if there is no request, the control unit 20 proceeds to step S117.

  When there is a request for Miracast connection from another source and the process proceeds to step S115, the control unit 20 performs a Miracast connection with the requested source. And the control part 20 acquires identification information from this source, and registers it in the connection source list | wrist 21a.

  Next, in step S116, the control unit 20 transmits a PAUSE message by RTSP to the currently connected source to suppress transmission of image information and the like, and the process proceeds to step S117.

  In step S117, the control unit 20 determines whether or not the user has instructed the end of mirroring. If the end of mirroring is not instructed, the control unit 20 returns the process to step S111. If the end of mirroring is instructed, the control unit 20 performs necessary end processing and ends the flow.

Hereinafter, a specific example when the projector 2 of the present embodiment operates according to the above flow will be described with reference to FIG.
For example, it is assumed that the projector 2 performs mirroring by making a Miracast connection only with the first computer 1a (step S106). Here, when there is a Miracast connection request from the second computer 1b to the projector 2 (step S102), the projector 2 maintains the Miracast connection with the first computer 1a, and also with the second computer 1b. Miracast connection is performed (step S103), and the second computer 1b is registered in the connection source list 21a. Further, the projector 2 transmits a PAUSE message to the second computer 1b to suppress transmission of image information and the like (step S108), and continues mirroring of the first computer 1a.

  Here, when the user operates the pointing device (touch pad 17 or mouse 18) of the first computer 1a to move the position of the pointer PT1a on the display image IM1a into the detection range Rd (step S111: Yes). ), The projector 2 executes source switching (step S112). Specifically, the projector 2 transmits a PAUSE message to the first computer 1a that is the current mirroring target, and stops transmission of image information and the like. In addition, the projector 2 refers to the connection source list 21a, determines the second computer 1b connected next to the first computer 1a as a target of the next mirroring, and gives PLAY to the second computer 1b. Send a message. As a result, transmission of image information and the like is started from the second computer 1b, and the projector 2 starts mirroring of the second computer 1b (step S113). Thereby, the image displayed by the projector 2 (image projection unit 25) is switched from the display image IM1a of the first computer 1a to the display image IM1b of the second computer 1b.

  Thereafter, when the user operates the pointing device (touch pad 17 or mouse 18) of the second computer 1b to move the position of the pointer PT1b on the display image IM1b into the detection range Rd (step S111: Yes). If the new source is not subsequently Miracast connected, the projector 2 returns the mirroring target to the first computer 1a. On the other hand, if a new source (for example, a third computer not shown) is Miracast connected, the mirroring target is switched to the new source.

  In this specific example, the first computer 1a corresponds to the first terminal device, and the display image IM1a of the first computer 1a corresponds to the first image. The second computer 1b corresponds to the second terminal device, and the display image IM1b of the second computer 1b corresponds to the second image.

  As described above, according to the projector 2 and its control method of the present embodiment, the following effects can be obtained.

  (1) According to the projector 2 of the present embodiment, the wireless communication unit 23 is wirelessly connected to both the first computer 1a and the second computer 1b, and image information from one of these computers 1 The coordinate information of the designated position is received. And since the control part 20 switches the image which the image projection part 25 displays based on the received coordinate information, it becomes possible to switch an image easily. Further, since the projector 2 is already wirelessly connected to both the first computer 1a and the second computer 1b at the time of switching images, the projector 2 is reconnected to the new computer 1 at the time of switching. Compared to the above, the time required for switching can be shortened, and the convenience for the user is improved.

  (2) According to the projector 2 of the present embodiment, the control unit 20 displays the image displayed by the image projection unit 25 based on the coordinate information received by the wireless communication unit 23, for example, the display of the first computer 1a. Since the image IM1a is switched to the display image IM1b of the second computer 1b, the display image IM1 can be easily switched.

  (3) According to the projector 2 of the present embodiment, when the source is switched, the control unit 20 stops transmission of image information from the source that has been the target of mirroring until now, so that unnecessary communication is suppressed. It becomes possible.

  (4) According to the projector 2 of the present embodiment, the control unit 20 starts transmission of image information to a source that has been newly mirrored when the source is switched. That is, transmission of image information from a new source can be stopped until the source is switched, so that unnecessary communication can be suppressed.

  (5) According to the projector 2 of the present embodiment, when the pointing position by the pointing device is moved within a predetermined range (detection range Rd), the display is displayed on the image projection unit 25 in order to switch the source to be mirrored. It is possible to easily switch the image to be performed.

(Modification)
Moreover, you may change the said embodiment as follows.

  In the above embodiment, when the source pointer PT1 being mirrored is positioned within the detection range Rd, the projector 2 switches the mirroring target to the next source in the connection order. However, the present invention is not limited to this mode. For example, when the pointer PT1 is positioned within the detection range Rd, the projector 2 displays a selection screen Ms (see FIG. 6) on which the source can be selected, superimposed on the display image IM2, and is desired as the next mirroring target. You may be able to select the source of

  Specifically, when the pointer PT1 is located within the detection range Rd, the control unit 20 of the projector 2 generates the selection screen Ms with reference to the connection source list 21a. Then, the control unit 20 instructs the image / sound processing unit 24 to superimpose the selection screen Ms on the display image IM2, and causes the image projection unit 25 to project the selection screen Ms. The selection screen Ms includes a list of identification information and the like of a plurality of connected sources, and the text “displaying” is added to the source currently being mirrored so that it can be understood that the source is being mirrored. Has been. In addition, one of the sources has a background color different from that of the other sources, indicating that the source is temporarily selected. When the user operates the input operation unit 22 of the projector 2 to select a desired source and confirm this, the control unit 20 switches the mirroring target to the source whose selection has been confirmed. According to this aspect, it becomes easy to mirror a desired source in a state where many sources are connected.

  Note that, when a desired source is selected on the selection screen Ms, it is possible to use a pointing device of the source (computer 1) instead of operating the input operation unit 22 of the projector 2. In this case, the control unit 20 of the projector 2 detects the movement of the pointing device based on the coordinate information transmitted from the computer 1 during mirroring, and switches the source to be selected according to this movement. Then, when the state where one source is selected continues for a predetermined time, the control unit 20 determines that the selection is confirmed, and switches the mirroring target to the source for which the selection is confirmed.

  In the above-described embodiment, the control unit 20 of the projector 2 switches the source when the mirrored source pointer PT1 is located within the detection range Rd. However, the pointer PT1 is within the detection range Rd. The source may be switched when a predetermined time elapses from the position. In this case, it is possible to prevent the source from being switched unintentionally due to an erroneous operation or the like.

  Further, the control unit 20 presets a plurality of detection ranges Rd in the display image IM1, and performs source switching when the pointer PT1 is positioned in a predetermined order within a predetermined time in the plurality of detection ranges Rd. May be. For example, as illustrated in FIG. 7, the control unit 20 sets the pointer PT1 within the first detection range Rd1 set at the upper left of the display image IM1, and then sets the second detection range set at the lower right. The source is switched when it moves within Rd2 within a predetermined time. According to this aspect, it is possible to further suppress unintentional switching of the source due to an erroneous operation or the like.

  In addition, when the locus of movement of the pointer PT1 is a predetermined figure, the control unit 20 may perform source switching. For example, as illustrated in FIG. 8, the control unit 20 performs source switching when the pointer PT <b> 1 moves so as to draw an inverted triangular locus. Also in this case, it is possible to further suppress the source from being switched unintentionally due to an erroneous operation or the like.

  Although not shown, the control unit 20 presets two detection ranges Rd in the display image IM1, and switches the sources in the connection order when the pointer PT1 is positioned in one detection range Rd. When located within the other detection range Rd, the source may be switched in the reverse order. According to this aspect, it becomes easy to mirror a desired source in a state where many sources are connected.

  In the above embodiment, the range of a predetermined size (number of pixels) is set as the detection range Rd. However, the control unit 20 determines the size (number of pixels) of the detection range Rd according to the size (number of pixels) of the display image IM1. You may make it adjust. In this case, the control unit 20 acquires information about the size of the display image IM1 from the computer 1 prior to the start of mirroring, and adjusts the size of the detection range Rd based on the acquired information. For example, the control unit 20 sets the detection range Rd to 100 × 100 pixels when the size of the display image IM1 is 1280 × 720 pixels, and detects when the size of the display image IM1 is 1920 × 1080 pixels. By setting the range Rd to 150 × 150 pixels, the size of the detection range Rd with respect to the size of the display image IM1 can be set to a certain ratio. According to this aspect, the size of the detection range Rd can be set to an appropriate size according to the size of the display image IM1.

  In the above embodiment, the projector 2 switches from the state in which one source (for example, the first computer 1a) is mirrored to the state in which the other one source (for example, the second computer 1b) is mirrored. Although the aspect has been described, a plurality of sources may be switched to a state of mirroring at the same time. For example, when the projector 2 is performing mirroring of only the first computer 1a (see FIG. 9A), when the pointer PT1 is positioned within the detection range Rd, the control unit 20 stores image information or the like on the first computer 1a. The transmission of image information or the like is started to the second computer 1b while the transmission of the image information is continued. Then, the control unit 20 changes the display state of the projector 2 (image projection unit 25) so that both the display image IM1a of the first computer 1a and the display image IM1b of the second computer 1b are included in one display image IM2. The display is shifted to the two-screen display state to be displayed (see FIG. 9B). That is, the display image IM2 projected from the image projection unit 25 in this case is an image including both the display image IM1a of the first computer 1a and the display image IM1b of the second computer 1b. Thereafter, when the pointer PT1 of the first computer 1a or the second computer 1b is positioned within the detection range Rd in the two-screen display state, the control unit 20 changes the display state of the projector 2 to only the second computer 1b. Switch to the mirroring state (see FIG. 9C). According to this aspect, it is possible to easily switch from a state in which only one source display image IM1 is displayed to a state in which a plurality of source display images IM1 are simultaneously displayed. In this modification, the display image IM2 in the two-screen display state corresponds to a third image including the first image (display image IM1a) and the second image (display image IM1b).

  In the above embodiment, when the source is switched (switching of the display image IM1) in steps S112 and S113, the control unit 20 stops transmission of image information to the source that has been the target of mirroring until then. However, it is not always necessary to stop the transmission of the image information. However, in order to suppress unnecessary communication, it is desirable to stop the transmission of image information for which mirroring (image display) is not performed. Similarly, in the above embodiment, when the source is switched in steps S112 and S113, the control unit 20 starts transmission of image information to the source that is newly targeted for mirroring. You may make it start transmission of image information (for example, when Miracast connection is performed). However, in order to suppress unnecessary communication, it is desirable not to start the transmission until mirroring (image display) is performed.

  In the above embodiment, the example in which the source (computer 1) requests Miracast connection to the sink (projector 2) in step S102 and step S114 has been described. However, the aspect in which the sink requests the source and performs Miracast connection. It may be.

  In the said embodiment, although the computer 1 is employ | adopted as a terminal device, a terminal device is not limited to the computer 1, For example, other terminal devices, such as a smart phone and a tablet terminal, may be sufficient. If the OS installed in the terminal device does not support Miracast or coordinate information transmission, an application program that implements these may be installed in the terminal device.

  In the above embodiment, the aspect in which the computer 1 and the projector 2 perform mirroring by Miracast is shown. However, the communication standard for performing mirroring is not limited to Miracast, but other communication standards such as WiDi and AirPlay (registered trademark). May be adopted.

  In the above-described embodiment, an aspect in which audio information is transmitted together with image information is shown, but transmission of audio information is not essential.

  In the above-described embodiment, the transmissive liquid crystal light valves 32R, 32G, and 32B are used as the light modulators. However, it is also possible to use a reflective light modulator such as a reflective liquid crystal light valve. Also, a digital mirror device that modulates the light emitted from the light source 31 can be used by controlling the emission direction of the incident light for each micromirror as a pixel. Further, the configuration is not limited to a configuration including a plurality of light modulation devices for each color light, and a configuration in which a plurality of color lights are modulated in a time division manner by one light modulation device may be employed.

  In the above embodiment, the projector 2 is employed as the image display device. However, the image display device is not limited to the projector 2 and may be another image display device such as a liquid crystal display or an organic EL display.

  In the above embodiment, the touch pad 17 and the mouse 18 are used as the pointing device of the computer 1. However, a track ball, a joystick, or the like may be used, and a touch panel that detects contact with the display unit 12 is employed. May be.

  DESCRIPTION OF SYMBOLS 1 ... Computer, 1a ... 1st computer, 1b ... 2nd computer, 2 ... Projector, 10 ... Control part, 11 ... Memory | storage part, 12 ... Display part, 13 ... Display control part, 14 ... Image sound processing part, DESCRIPTION OF SYMBOLS 15 ... Wireless communication part, 16 ... Keyboard, 17 ... Touchpad, 18 ... Mouse, 20 ... Control part, 21 ... Memory | storage part, 21a ... Connection source list, 22 ... Input operation part, 23 ... Wireless communication part, 24 ... Image Audio processing unit, 25 ... image projection unit, 26 ... audio output unit, 31 ... light source, 32R, 32G, 32B ... liquid crystal light valve, 33 ... projection lens, 34 ... light valve drive unit, 100 ... image display system, IM1, IM1a, IM1b, IM2 ... display image, Ms ... selection screen, PT1, PT1a, PT1b, PT2 ... pointer, Rd ... detection range, Rd1 ... first detection range , Rd2 ... the second of the detection range, SC ... screen.

Claims (13)

Wirelessly connected to both the first terminal device that displays the first image and the second terminal device that displays the second image, and at least one of the first terminal device and the second terminal device A wireless communication unit that receives the image information and the coordinate information of the indicated position;
A display unit that displays at least one of the first image and the second image based on the image information received by the wireless communication unit;
A control unit that switches an image displayed on the display unit from the first image to an image including the second image based on the coordinate information received by the wireless communication unit;
An image display device comprising: The image display device according to claim 1,
The control unit switches an image displayed on the display unit from the first image to the second image based on the coordinate information received by the wireless communication unit. The image display device according to claim 1 or 2,
The control unit causes the first terminal device to stop transmitting the image information when the image displayed on the display unit is switched from the first image to an image including the second image. An image display device. The image display device according to claim 1,
The control unit includes, based on the coordinate information received by the wireless communication unit, an image to be displayed by the display unit including a first image and a second image from the first image. An image display device characterized by switching to an image. The image display device according to any one of claims 1 to 4,
The control unit causes the second terminal device to start transmitting the image information when the image displayed on the display unit is switched from the first image to an image including the second image. An image display device. An image display device according to any one of claims 1 to 5,
The control unit switches an image displayed by the display unit when an instruction position based on the coordinate information received by the wireless communication unit is within a predetermined range. The image display device according to claim 6,
The control unit switches the image displayed on the display unit when a predetermined time has elapsed since the indicated position based on the coordinate information received by the wireless communication unit is located within the predetermined range. A characteristic image display device. The image display device according to claim 6 or 7,
When the wireless communication unit receives image information corresponding to the first image and the coordinate information from the first terminal device, the control unit is based on the size of the first image. An image display device that adjusts the size of the predetermined range. An image display device according to any one of claims 1 to 5,
The control unit switches an image displayed by the display unit when an instruction position based on the coordinate information received by the wireless communication unit is positioned in a predetermined order within a plurality of preset ranges. An image display device. An image display device according to any one of claims 1 to 5,
The control unit switches an image displayed by the display unit when a locus of an indicated position based on the coordinate information received by the wireless communication unit is a predetermined figure. The image display device according to any one of claims 1 to 10,
The said control part displays the selection screen for selecting the image which the said display part displays based on the said coordinate information received by the said wireless communication part on the said display part, The image display apparatus characterized by the above-mentioned. An image display system comprising: a first terminal device that displays a first image; a second terminal device that displays a second image; and an image display device,
The image display device includes:
Wirelessly connected to both the first terminal device and the second terminal device, and image information and coordinate information of the indicated position from at least one of the first terminal device and the second terminal device. A wireless communication unit for receiving;
A display unit that displays at least one of the first image and the second image based on the image information received by the wireless communication unit;
A control unit that switches an image displayed on the display unit from the first image to an image including the second image based on the coordinate information received by the wireless communication unit;
An image display system comprising: Wirelessly connected to both the first terminal device that displays the first image and the second terminal device that displays the second image, and at least one of the first terminal device and the second terminal device Receiving image information and coordinate information of the indicated position,
Based on the received image information, at least one of the first image and the second image is displayed on a display unit,
Based on the received coordinate information, the image displayed on the display unit is switched from the first image to an image including the second image.
And a control method for the image display device.

Images