JP5570304B2 - Display device and system - Google Patents

Description

  The present invention relates to a display device and system used for presentation.

JP 2002-229546 A JP 2008-123476 A

  Conventionally, a projector is known as a display device that displays presentation materials in a conference room on a large screen. In addition, there is a projector of the type that displays on the desk surface, and it is used as a communication tool for all participants in the conference to view the display screen and share information and discuss.

  In a projector that displays on a desk surface, an object may be placed on the desk surface. The image displayed on the object is not visible, and the information displayed around the object is very difficult to see due to the unevenness of the object. On the other hand, a technique for displaying information on a portion hidden by an object at another position has been proposed (see Patent Document 1).

  On the other hand, a method of using a communication device that cooperates with a display device on a display screen has been proposed. For example, Patent Document 2 describes that when a communication device is placed on a specific icon on a display screen, a processing menu for the communication device is displayed on a liquid crystal touch panel. Since the processing menu of the communication device is displayed on the large screen, the operation of the communication device is facilitated.

  In the case of adopting a technique for starting a predetermined process by placing a specific device on an icon on the display screen, the technique of Patent Document 1 cannot be adopted as it is.

The present invention, when a particular device is placed on the display screen, and displays moving images composed composed and less visible invisible at that particular device to another position, the display position when a specific device An object of the present invention is to present a display device and a display system that do not move the display.

To achieve the above object, the display device according to the present invention includes a communication means for communicating with the communication device, display means for displaying an image including a predetermined display element, wherein the image displayed by the display means Determining means for determining whether or not an object placed so as to conceal a predetermined display element is the communication device; and control means for performing control according to the determination result of the determining means; When the object placed so as to conceal the predetermined display element included in the image is the communication device, the communication means and the communication device placed so as to conceal the predetermined display element between the said controlled to perform a predetermined communication corresponding to a predetermined display element, when an object placed so as to conceal the predetermined display element is not a said communication device, which is displayed by the display means image In the display position of the predetermined display element, and controls to move without being concealed position by the object.
The display system according to the present invention is a display system having a display device and an information processing device that transmits image data to the display device, wherein the display device communicates with a communication device, and the information processing device Communication means for communicating with the apparatus; display means for displaying an image related to image data including a predetermined display element transmitted from the information processing apparatus; and the predetermined display element in an image displayed by the display means Determining means for determining whether or not the object placed so as to conceal is the communication device, and means for controlling according to the determination result of the determining means, the determination result of the determining means by the communication means Is transmitted to the information processing apparatus, and when the object placed so as to conceal the predetermined display element included in the image is the communication apparatus, the predetermined display element is concealed Control means for controlling to perform communication corresponding to the predetermined display element between the communication device and the communication means placed in between, and between the communication means and the information processing device. The information processing apparatus is configured to display the predetermined display element when the object placed so as to conceal the predetermined display element is not the communication apparatus based on the determination result of the determination means transmitted by the communication means. Image data indicating an image moved to a position where the display position is not concealed by the object is transmitted to the display device.

  According to the present invention, when an object that is not a communication device is placed on a specific display element, the specific display element is moved to a position that is not concealed, so that the usability of the user is improved.

It is a schematic block diagram of one Example of this invention. It is a system configuration diagram of the present embodiment. It is an optical system figure which shows the calculation method of the distance to a projection surface. It is a flowchart of the setting for measuring the position of a wireless terminal. It is an operation | movement flowchart of a projector when an object is set | placed on the projection surface. It is a figure which shows the example of a change of a display screen when an object is set | placed on the icon. It is a figure which shows another example of a change of a display screen when an object is set | placed on the icon. It is a flowchart which shows the data transmission between the object put on the icon, and PC. It is another operation | movement flowchart of a projector when an object is set | placed on the projection surface. 10 is an operation flowchart of the PC corresponding to FIG. 9.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a schematic block diagram of a projector and a personal computer (PC) constituting a display system which is an embodiment of a display device according to the present invention. The PC is an example of an information processing apparatus that transmits image information to a projector. FIG. 2 is a schematic diagram showing a usage configuration of the projector and the PC.

  In FIG. 2, a projector 100 projects and displays image data stored in a built-in storage or image data transmitted from a personal computer (PC) 400 via a wireless LAN on a projection plane 200. The projector 100 can communicate with a plurality of access points 202, 204, and 206 via a wireless LAN, and can also communicate with a digital camera 208 having a wireless LAN function. The digital camera 208 is an example of a wireless terminal. On the other hand, the PC 400 can also receive information such as coordinates from the projector 100 via the wireless LAN.

  CPU 101 controls various operations of projector 100. Specifically, the CPU 101 controls each unit via the CPU bus 150. Connected to the CPU bus 150 are a memory 102 that temporarily stores data and programs, and a nonvolatile storage unit 110 that retains the memory even when the power is turned off. The storage unit 110 stores data and programs that are not erased even when the power is turned off.

  An object position detection program 111, a contact determination program 112, a projection size calculation program 113, a wireless terminal position detection program 114, an image recognition program 115, and an image processing program 116 are stored in the storage unit 110. The object position detection program 111 is a program for causing the CPU 101 to realize a function for obtaining the position of an object placed on the projection plane 200. The contact determination program 112 is a program that causes the CPU 101 to realize a function of determining that an object is placed on the projection plane 200. The projection size calculation program 113 is a program that causes the CPU 101 to realize a function of calculating the size of the projection screen being projected. The wireless terminal position detection program 114 is a program that causes the CPU 101 to realize a function of detecting the position of a wireless terminal equipped with a wireless LAN. The image recognition program 115 is a program that causes the CPU 101 to realize a function of recognizing an object (icon or the like) included in a projected image. The image processing program 116 is a program that causes the CPU 101 to realize a function of performing arbitrary processing on a projected image.

  In addition, programs such as an operating system and projection control, image control, and wireless LAN control are stored in the storage unit 110.

  These programs are developed and executed in the memory 102 by the CPU 101 as necessary. Detailed operation of each program will be described later.

  The CPU 101 controls the image processing unit 103 to adjust the hue and brightness of the image to be projected, and further controls the projection control unit 104 to control lens driving, lamp on / off, and the like. For example, the distance between the projector 100 and the projection plane 200 is detected by controlling the distance detection unit 105 including an infrared sensor. The projection lens position detection unit 106 periodically detects lens position information and notifies the CPU 101 of it. The image input unit 107 receives image data sent from, for example, a VGA cable, and supplies the received image data to the image processing unit 103. The projection control unit 104 projects the image indicated by the image data processed by the image processing unit 103 onto the projection plane 200.

  The CPU 101 can transmit and receive a packet conforming to the wireless LAN standard through the communication unit 120 including the antenna 123, the baseband unit 121, and the RF unit 122. A radio signal transmitted from a base station (not shown) is received by the antenna 123, and the received signal is input to the RF unit 122. The RF unit 122 includes a high-frequency amplifier, a frequency converter, and a demodulator. The RF unit 122 amplifies the signal received by the antenna 123 with a low noise amplifier and then converts the frequency to a received baseband signal by the baseband unit 121 to demodulate the signal.

  The input / output control unit 130 receives input signals from input devices such as the remote control 131, the keyboard 132, and the mouse 133, and transfers them to the CPU 101.

  The imaging unit 141 of the projector 100 captures a moving image of a range including the projection plane. The signal processing unit 142 compresses and encodes the moving image data generated by the imaging unit 141 using a known encoding method and records the data on a recording medium. Further, the signal processing unit 142 can decode and reproduce the compressed moving image data recorded on the recording medium.

  The configuration of the PC 400 will be described. The CPU 401 controls various operations of the PC 400. That is, the CPU 401 controls each unit via the CPU bus 430. Connected to the CPU bus 430 are a memory 402 for temporarily storing data and programs, and a non-volatile storage unit 403 for retaining the memory even when the power is turned off. The storage unit 403 stores data and programs that are not erased even when the power is turned off.

  The CPU 401 receives key inputs from the keyboard 411 and the mouse 412 via the input / output control unit 410.

  The CPU 401 controls the image processing unit 406 to adjust the color and brightness of the image to be displayed, and further causes the display unit 405 to display the image via the display control unit 404. The display control unit 404 is connected to a display unit 405 such as a display via a VGA cable or a DVI cable.

  The CPU 401 can transmit and receive a packet conforming to the wireless LAN standard through the communication unit 420 including the antenna 423, the baseband unit 421, and the RF unit 422. A radio signal transmitted from a base station (not shown) is received by the antenna 423, and the received signal is input to the RF unit 422. The RF unit 422 includes a high frequency amplifier, a frequency converter, and a demodulator. The RF unit 422 amplifies the signal received by the antenna 423 with a low noise amplifier and then frequency-converts the received baseband signal to the baseband unit 421 to demodulate the signal.

With reference to FIG. 3, a method of calculating the projection screen size will be described. The size of the liquid crystal panel 41 is W ₀ , and the distance from the liquid crystal panel 41 to the projection lens 42 is F. Further, the distance from the projection lens 42 to the projection plane 43 is L, the projection size to obtain a W _1. The projection lens position detection unit 106 detects the distance F from the liquid crystal panel 41 to the projection lens 42. The distance detection unit 105 detects the distance L from the projection lens 42 to the projection plane 43. Size _{W 1} ask is,
W ₁ = W ₀ × (L / F)
Given in.

  A table in which the output result of the line sensor used for the focus adjustment of the projector 100 and the position of the projection lens 42 are associated in advance may be prepared, and the distance may be calculated with reference to this table.

  FIG. 4 shows a flowchart of an operation in which the CPU 101 of the projector 100 detects a wireless terminal placed on the projection plane 200. With reference to FIG. 4, the initial setting of the projector 100 will be described.

  The CPU 101 causes the distance detection unit 105 to calculate the distance to the projection plane 200 (S101). Then, the projection size calculation program 113 operating on the CPU 101 calculates the size of the projection plane from the information on the projection lens position acquired from the projection lens position detection unit 106 (S102). A wireless terminal detection area is set within the range of the calculated projection size (S103). For example, an image diagram showing the relative positional relationship between the projection plane and the wireless terminal detection area is projected onto the projection plane 200, and the user can determine which range is the detection area with respect to the projection plane by using the remote control 131, the keyboard 132, or the mouse 133. Let me tell you. The CPU 101 stores the instructed range in the memory 102 as a wireless terminal detection area (S104).

  The three-dimensional coordinates of the digital camera 208 as a wireless terminal can be calculated by knowing the distances from three or more wireless access points whose three-dimensional coordinates are known. In order to detect the position (three-dimensional coordinates) of the camera 208, the position (three-dimensional coordinates) of each access point 202, 204, 206 is stored in the memory 102 (S106). Specifically, the user inputs the position (three-dimensional coordinate) of each access point 202, 204, 206, and the CPU 101 stores the input coordinate value in the memory 102.

  The digital camera 208 periodically emits a probe signal of a MAC frame defined in the wireless LAN 802.11 standard. The projector 100 can detect the presence of the wireless terminal by receiving this signal through the communication unit 120. Each of the access points 202 to 206 also receives a probe signal from the digital camera 208 that is a wireless terminal, like the projector 100.

  Projector 100 transmits a beacon signal with a time stamp as a synchronization signal for time adjustment to all wireless devices including access points 202 to 206. Receiving this beacon signal, each of the access points 202 to 206 sets the clock based on the received time stamp. Each of the access points 202 to 206 and the projector 100 store the time when the probe signal from the digital camera 208 is received under a clock synchronized with each other.

ただし、式（２）で、ｃは電波伝搬速度を示す。ｗ_ｉは非負の重み付け係数である。ｔ_ｂはｔ_１，ｔ_２，・・・，ｔ_ｎのうちの基準とする適当な何れかである。δは基準のクロック誤差である。｜ｘ｜はベクトルｘの大きさである。 The three-dimensional position coordinates of the camera 208 can be calculated by, for example, a TDOA (Time Difference Of Arrival) method. In general terms, the coordinates of the plurality of access points and the projector 100 are P ₁ , P ₂ ,..., P _n, and the times at which each access point receives the probe signal from the digital camera 208 are t ₁ , t ₂ , ..., and _{t n.} The terminal-to-terminal position P is obtained as coordinates that minimize the square error E (p, δ) expressed by the following equation (1). That is,

However, in Formula (2), c shows a radio wave propagation speed. w _i is a non-negative weighting factor. t _b is _{t 1, t 2, ···,} is any suitable as a reference of the _{t n.} δ is a reference clock error. | X | is the magnitude of the vector x.

  Each access point 202 to 206 notifies the projector 100 of the time when the probe signal from the digital camera 208 is received. The object position detection program 111 of the projector 100 refers to the position coordinates of the access points 202 to 206 and the probe signal reception time, and calculates the three-dimensional position of the camera 208 using the above calculation formula. In addition to the TDOA method, the three-dimensional position of the camera 208 can be detected by an RSSI (Received Signal Strength Indicator) method that detects a position based on a difference in electric field strength. Then, by determining whether or not the camera 208 exists at the coordinates within the detection range of the projection plane, it is determined whether or not the camera 208 that can communicate with the projector 100 is inserted in the detection range. Can do.

  If the position / size of the image on the enlarged projection surface is changed by moving the projector 100, shifting the projection lens, or changing the magnification, the steps S102 to S105 are executed again. .

  FIG. 5 shows an operation flowchart when the digital camera 208 or the object 210 that is not the camera 208 is placed on the projection plane 200. FIG. 6A shows an example of a display image when the camera 208 is placed on the icon 212 displayed on the projection plane 200. FIG. 6B shows an example of a display image when an object 210 that is not a wireless terminal is placed on an icon 212 displayed on the projection plane 200.

  The CPU 101 determines whether a digital camera 208 that is a wireless terminal or an object 210 that is not a wireless terminal is placed on the projection plane 200 (S201). The contact determination program 112 that is constantly operating on the CPU 101 detects that the camera 208 or the object 210 is placed on the projection plane 200. Specifically, the imaging unit 141 causes the projection plane 200 to be imaged at regular intervals, and the unmoving object detection technique used in a surveillance camera or the like is used. Non-moving object detection technology compares captured images between frames, identifies an object when there is a difference, and recognizes that the object is a placed object when the identified object does not move for a certain period of time It is. In this embodiment, such a non-conductor detection technique is used. However, an object placed in the photographing screen may be detected using other techniques.

  When detecting that the camera 208 or the object 210 is placed, the CPU 101 loads the object position detection program 111 into the memory 102 and executes it. The object position detection program 111 acquires the coordinates of the camera 208 or the object 210 placed on the projection plane (S202). At this time, the CPU 101 controls the imaging unit 141 to capture an image of the projection plane 200 including the camera 208 or the object 210, and determines coordinates on the projection plane 200 from the relative position of the camera 208 or the object 210 on the projection plane 200.

  The CPU 101 loads the image recognition program 115 into the memory 102 and executes it. The image recognition program 115 determines whether or not there is a display element such as an icon at a position corresponding to the position of the camera 208 or the object 210 (S203). This process is executed, for example, by determining whether an image that matches the icon image database recorded on the recording medium of the projector 100 has been detected in the captured image. Further, it is executed by determining whether or not the coordinates of the detected position and the position of the camera 208 or the object 210 overlap.

  When something is placed on the icon (S203), the CPU 101 determines whether or not the placed object is a wireless terminal (camera 208) (S204). This determination is based on whether or not the coordinates of the camera 208 that can communicate with the projector 100 described in the flow of FIG. 4 coincide with the coordinates of the detected icon 208 or the camera 208 or the object 210 detected in S202. Is determined by In the case of the camera 208 (S204), the CPU 101 maintains the display image on the projection plane as shown in FIG. In the case of the object 210 that is not a wireless terminal (S204), the CPU 101 changes the display position of the icon 212 that is partially or entirely hidden by the object 210 to a position that is not hidden by the object 210 (S205). Thereby, the problem that the icon 212 becomes difficult to see with the object 210 that is not a wireless terminal can be avoided. The change of the position of the icon 212 is performed by the CPU of the projector 100 modifying the image data transferred from the PC 100. Specifically, processing is performed such that the image information of the icon 212 at the position where it is hidden is duplicated and an image pasted at a position where another icon does not exist is generated.

  If the icon is displayed on the entire display screen and there is no room for moving the icon as it is, as shown in FIG. 7, a part or all of the size of the icon is reduced to create a margin for moving the icon and move it. You may do it.

  The movement amount or movement direction of the icon 212 may be determined in advance by the user.

  Next, data exchange between the camera 208 and the folder associated with the icon 212 when the camera 208 is placed on the icon 212 will be described. FIG. 8 shows a flowchart of the operation.

  The user sets in the projector 100 which of the camera 208 and the PC 400 is the transmission side (S301). For example, a predetermined setting screen is displayed on the projector 100, and the user designates the transmission side using the remote control 131, the keyboard 132, or the mouse 133.

  When the camera 208 is set to the transmission side (S302), the CPU 101 of the projector 100 controls the communication unit 120 to receive data from the camera 208 (S303). The CPU 101 further controls the communication unit 120 to transmit the data to the folder associated with the icon 212 of the PC 400 (S304).

  When the PC 400 is set as the transmission side (S302), the CPU 101 of the projector 100 controls the communication unit 120 to receive data in the folder associated with the icon 212 from the PC 400 (S305). The CPU 101 further controls the communication unit 120 to transmit the data received from the PC 400 to the camera 208 (S306).

  With such processing, the user can feel as if the camera 208 and the icon 212 are communicating. The data to be transmitted / received may be all data owned by each or only specific data. Further, the projector 100 may acquire a list of data of folders associated with the camera 208 or the icon 212, and allow the user to select data to be transmitted / received from the list. In addition, when the object 210 is arranged instead of the camera 208, the position of the icon can be changed to a position different from the position of the object 210, which leads to an improvement in user convenience.

  Although the embodiment using one camera 208 as a wireless terminal has been described, the present invention can be extended when a plurality of wireless terminals are used. Even when there is no access point, it is possible to detect the position only by the projector 100 without obtaining accuracy.

  Although the position of the object is detected by the imaging unit 141, a pressure sheet may be placed on the display surface, and the position of the object may be detected by the pressure of the object.

  Although the icon has been described as an example of the specific display element on the display surface, an image, a window, or the like other than the icon may be considered as the specific display element.

  Although an embodiment using a projector has been described, a normal display may be used. In addition, in a notebook PC or the like, when a communication device is arranged over the icon displayed on the display unit, communication is performed with the communication device, and when an object other than the communication device is arranged over the icon, the icon is displayed. The display position of may be changed.

  When the object 210 is placed on the projection plane 200 and the projector 100 changes the display position of the icon 212 of the image received from the PC 400, the display screen of the PC 400 and the projection image of the projector 100 are different. Such a difference can be solved by changing the display screen of the PC 400 in the same manner as the change of the projection image of the projector 100. In the first place, the projection image when the object 210 is placed may be changed on the PC 400 side and transmitted to the projector 100. FIG. 9 shows an operation flowchart of the projector 100, and FIG. 10 shows an operation flowchart of the PC 400.

  In this example, the projector 100 has an access point function, and projects and displays an image transmitted from the PC 400 via the wireless LAN. In addition, the projector 100 can remotely control the PC 400 via a wireless LAN. Specifically, the projector 100 can control the movement of icons and windows on the PC 400, the expanded display of folders related to icons, the display of other information related to icons, and the like. Such remote operation can be executed by various communication protocols, and details thereof are not related to the gist of the present invention, and thus description thereof is omitted.

  In FIG. 9, the CPU 101 of the projector 100 determines whether or not an object such as the camera 208 has been placed on the projection plane 200 by the contact determination program 112 (S401). When it is detected that an object such as the camera 208 is placed (S401), the CPU 101 acquires the coordinates of the object placed on the projection plane by the object position detection program 111 (S402). Here, by comparing the image data captured by the imaging unit 141 of the projector 100 with the image data transferred from the PC 400, first, an area of the image transferred from the PC 400 in the captured image is detected. Then, from the position coordinates of the object and the area of the image transferred from the PC 400, it is detected at which coordinate of the image output by the PC 400.

  The projector 100 transmits the coordinates of the detected object to the PC 400 (S403). Upon receiving the coordinate information from the projector 100 (S501), the PC 400 determines whether there is any specific information such as an icon at the position where the object is placed (S502), and transmits the determination result to the projector 100 (S503). ). When there is no specific display element such as an icon at the position where the object is placed (S504), the PC 400 ends the process. You may return to step S501 in preparation for the case where another object is placed. When there is a specific display element such as an icon at the position where the object is placed (S504), the PC 400 waits for a wireless terminal determination result from the projector 100 (S505).

  The projector 100 receives the determination result from the PC 400 (S404). As in the first embodiment, the CPU 101 determines whether an object is placed on the icon on the projection plane (S405). When the object is on the icon (S405), the CPU 101 determines whether the object is a wireless terminal represented by the camera 208 by the same method as in the first embodiment (S406), and transmits the determination result to the PC 400 ( S407).

  The PC 400 receives the wireless terminal determination result from the projector 100 (S505). When the placed object is not a wireless terminal typified by the digital camera 208 (S506), the PC 400 moves the icon to an area where the camera 208 does not exist on the display image as illustrated in FIG. S507). The PC 400 transmits the changed image to the projector 100, and the projector 100 projects and displays the image from the PC 400 on the projection surface. By doing so, the projection system of the present embodiment can save the position of the icon when the object 210 that cannot communicate data such as the camera 208 is arranged on the icon. it can. Therefore, it is possible to improve the usability of the user.

  As in the first embodiment, when the icons cannot be moved due to the large number of icons on the screen, some or all of the icons on the screen may be reduced, and the icons may be moved to a free space that can be created.

  The preferred embodiments of the present invention have been described above, but the present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the gist thereof.

Claims (4)

A communication means for communicating with the communication device;
Display means for displaying an image including a predetermined display element ;
Discriminating means for discriminating whether or not an object placed so as to hide the predetermined display element in the image displayed by the display means is the communication device;
Control means for performing control according to the determination result of the determination means
And
When the object placed so as to hide the predetermined display element included in the image is the communication device, the control means is placed so as to hide the predetermined display element. with the communication apparatus, when the predetermined display element was controlled so as to perform a predetermined communication corresponding, object placed so as to conceal the predetermined display element is not a said communication device, wherein the display means display device on a said image to be displayed, the display position of the predetermined display element, characterized in <br/> be controlled to move without being concealed position by the object by. When the object placed so as to conceal the predetermined display element included in the image is the communication device, the control means moves the display position of the predetermined display element to a position not concealed by the object The display device according to claim 1, wherein the display device is controlled so as not to occur. Imaging means for imaging a range including the image displayed by the display means;
Detecting means for detecting the position of the object from an image obtained by the imaging means ;
Means for determining whether or not the object is placed so as to hide the predetermined display element based on the position of the object detected by the detection means
The display device according to claim 1, characterized in that it comprises a. A display system having a display device and an information processing device that transmits image data to the display device,
The display device
Communicates with the communication device also includes a communication means for communicating with the information processing apparatus,
Display means for displaying an image related to image data including a predetermined display element transmitted from the information processing apparatus;
Discriminating means for discriminating whether or not an object placed so as to hide the predetermined display element in the image displayed by the display means is the communication device;
Control means according to the determination result of the determination means, wherein the communication means transmits the determination result of the determination means to the information processing apparatus so as to hide the predetermined display element included in the image When the object placed on the communication device is the communication device, the communication device placed between the communication device and the communication device, and the communication device and the information processing device placed so as to hide the predetermined display element. And control means for controlling to perform communication corresponding to the predetermined display element
And
The information processing apparatus, based on said discrimination result of said discriminating means is transmitted by the communication means, when an object placed so as to conceal the predetermined display element is not a said communication device, the display of the predetermined display element display system, characterized in that the position to transmit the image data representing the image which has moved to not concealed position by the object on the display device.

Images