JP2015060197A - Projection device, projection control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To secure sufficient safety and effectively utilize light component originally not used for a projection when projecting images on indeterminate-shape screens, and to further increase appealing power as digital signage boards.SOLUTION: There are provided: projection systems 21 to 26 that project an image; an imaging part IM that acquires a shape of a screen on which the images by the projection systems 21 and 26 are projected; and a CPU 32 that, in accordance with the shape of the screen acquired by the imaging part IM, uses a part of areas in which projection by the projection systems 21 to 26 is available to cause the image to be projected, determines whether a communication object is present in the vicinity of a peripheral edge of the screen, and in accordance with a result of the determination, causes the projection systems 21 to 26 to execute a visible light data transmission to the communication object in the vicinity of the peripheral edge of the screen by using a peripheral edge of the image.

Description

  The present invention relates to a projection apparatus, a projection control method, and a program that are particularly suitable for electronic signboards installed in storefronts, product shelves, and the like.

  2. Description of the Related Art Conventionally, there has been proposed a device equipped with a video output device in which video content is projected onto a humanoid screen or the like by rear projection projection in order to enhance the impression to the viewer. (For example, Patent Document 1)

JP 2011-150221 A

  In this type of digital signage (electronic signage) including the techniques described in the above-mentioned patent documents, the display element itself is used even though it has a rectangular display area. In many cases, the signboard portion to which the optical image formed in this way is projected is an indeterminate shape according to the content such as a humanoid shape as described above.

  For this reason, the display element displays the content image only in the area effective for projection according to the shape of the screen, while the other area always displays a black image so that unnecessary light does not leak outside the screen. Therefore, there is a problem that the projectable area is not effectively used.

  The present invention has been made in view of the above circumstances, and its purpose is to use it for projection while ensuring sufficient safety when projecting an image on an irregular screen. An object of the present invention is to provide a projection device, a projection control method, and a program that can effectively improve the appeal as an electronic signage by effectively utilizing light components that are not used.

  According to one aspect of the present invention, a projection unit that projects an image, a shape acquisition unit that acquires a shape of a screen that projects an image by the projection unit, and the projection unit according to the shape of the screen acquired by the shape acquisition unit The first projection control means for projecting an image using a part of the projectable area by the computer, the determination means for determining whether or not there is a communication object near the periphery of the screen, and the determination result by the determination means Accordingly, there is provided a second projection control unit that causes the projection unit to execute visible light data transmission to the communication target in the vicinity of the periphery of the screen by using the periphery of the image.

  According to the present invention, when an image is projected onto an irregular screen, while ensuring safety, the light component that is not originally used for projection is effectively used to further improve the appeal as an electronic signboard. It becomes possible.

The perspective view which shows the external appearance structure of the digital signage which concerns on one Embodiment of this invention. The side view which shows the structure of the projection optical system which concerns on the same embodiment. FIG. 3 is a block diagram showing a functional configuration of the electronic circuit according to the embodiment. The figure which shows the some projection image memorize | stored in the memory card with which the memory card mounting part of FIG. 3 concerning the embodiment was mounted | worn, and its relationship. . The flowchart which shows the content of the projection process which concerns on the same embodiment. The figure which shows the allocation structure of the image within the projectable area | region which concerns on the same embodiment.

Hereinafter, an embodiment in which the present invention is applied to a rear projection type digital signage will be described in detail with reference to the drawings.
FIG. 1 is a perspective view showing an external configuration of a digital signage 10 according to the present embodiment. A replaceable signage board SB is erected on the upper front end side of the apparatus housing 10A. This signage board SB has a translucent plate-like configuration having an arbitrary shape, which is installed so as to be within the originally rectangular projectable area of the digital signage 10.

  Near the bottom of this signage board SB, a plurality of, here four, operation buttons B1 to B4 are projected together, and when the viewer touches any of these buttons, they are arranged on the board mounting base. The operation position can be detected by a linear infrared sensor array each having directivity. One of the operation buttons B1 to B4 includes an operation button for starting visible light communication for a viewer who browses the signage board SB (for example, a customer who passes through the store where the digital signage 10 is installed). .

FIG. 2 is a view of the configuration of the projection optical system provided on the upper part of the apparatus housing 10A of the digital signage 10 as viewed from the right side.
The projected light beam emitted obliquely upward and rearward from the projection lens barrel 11 is reflected to the front side by the total reflection mirror 12 and then deflected to a horizontal parallel light beam by the Fresnel lens sheet 13 to form a translucent curtain shape. Projected on the rear project screen 14.

  A transparent board 15 is integrally formed on the front side of the rear project screen 14. The three layers of the Fresnel lens sheet 13, the rear project screen 14, and the transparent board 15 constitute the signage board SB.

  Next, the functional configuration of the electronic circuit mainly of the digital signage 10 will be described with reference to FIG. In the figure, image data is read from a memory card (not shown) attached to the memory card attachment unit IP and sent to the projection image drive unit 21 via the system bus B.

  FIG. 4 is a diagram showing a plurality of projection images stored in the memory card attached to the memory card attachment unit IP and the relationship thereof. As shown in the figure, a plurality of promotional image data is stored in the memory card, and data content information used in visible light communication is stored in association with each image data.

  The projection image drive unit 21 multiplies a frame rate according to a predetermined format, for example, 120 [frames / second], the number of color component divisions, and the number of display gradations, according to the transmitted image data. The micromirror element 22 as a display element is driven to display by faster time-division driving.

  The micromirror element 22 performs display operation by individually turning on / off each tilt angle of a plurality of micromirrors arranged in an array, for example, WXGA (horizontal 1280 pixels × vertical 768 pixels) at high speed. Thus, an optical image is formed by the reflected light.

  On the other hand, primary color lights of R, G, and B are emitted from the light source unit 23 in a time-sharing manner. The light source unit 23 includes an LED which is a semiconductor light emitting element, and repeatedly emits R, G, and B primary color lights in a time-sharing manner. The LED included in the light source unit 23 may include an LD (semiconductor laser) or an organic EL element as an LED in a broad sense.

  Moreover, it is good also as what uses the primary color light from which a wavelength differs from the original light excited by irradiating the light radiate | emitted from LED to a fluorescent substance. The primary color light from the light source unit 23 is totally reflected by the mirror 24 and applied to the micromirror element 22.

  Then, an optical image is formed by the reflected light from the micromirror element 22, and the formed optical image is projected to the outside through the projection lens unit 25. The projection lens barrel 11 shown in FIG. 2 includes the projection lens unit 25 as a main element.

  The projection lens unit 25 includes a focus lens for moving the focus position in the internal lens optical system, and the lens is aligned by the lens motor (M) 26 along the optical axis direction via a gear mechanism (not shown). The position is selectively driven.

  Further, an imaging unit IM is provided in the vicinity of the projection lens unit 25 to capture an image of the projectable region. The imaging unit IM includes a photographic lens unit 27 facing in the same direction as the projection lens unit 25 and a CMOS image sensor 28 that is a solid-state imaging device disposed at a focal position of the photographic lens unit 27.

  An image signal obtained by the CMOS image sensor 28 is digitized by the A / D converter 29 and then sent to the captured image processing unit 30.

  The captured image processing unit 30 scans and drives the CMOS image sensor 28 to execute an imaging operation, and performs image processing such as contour extraction and pattern matching on image data obtained by imaging, so that the captured image is detected. The shape of the signage board SB projected by the projection lens unit 25 or the recognition of a communication device such as a smartphone that is the target of the visible light communication can be executed.

  Further, the photographed image processing unit 30 drives a lens motor 31 (M) 31 for moving a focus lens position that constitutes a part of the photographing lens unit 27. The photographed image processing unit 30 drives the lens motor 31 by, for example, a contrast-type automatic focusing function to move the focus lens of the photographing lens unit 27 along the optical axis direction, and sets the focus distance of the image with the highest contrast. By obtaining, it is possible to acquire the distance to the device that is the target of visible light communication.

  The CPU 32 controls all the operations of the above circuits. The CPU 32 is directly connected to the main memory 33 and the program memory 34. The main memory 33 is composed of, for example, an SRAM and functions as a work memory for the CPU 32. The program memory 34 is composed of an electrically rewritable nonvolatile memory such as a flash ROM, and stores an operation program executed by the CPU 32, various fixed data, and the like.

  The CPU 32 performs overall control of the digital signage 10 by reading out the operation program, fixed data, and the like stored in the program memory 34, developing and storing them in the main memory 33, and executing the program. To do.

  The CPU 32 executes various projection operations in accordance with operation signals from the operation unit 35. The operation unit 35 detects a key operation signal of several operation keys including a power key provided in the main body of the digital signage 10 or an operation to a button virtually projected on a part of the signage board SB. A detection signal from the infrared sensor array is received, and a signal corresponding to the received operation is sent to the CPU 32.

The CPU 32 is further connected to the audio processing unit 36 via the system bus B.
The sound processing unit 36 includes a sound source circuit such as a PCM sound source, converts the sound signal given during the projection operation into an analog signal, drives the speaker unit 37 to emit sound, or generates a beep sound or the like as necessary.

Next, the operation of the above embodiment will be described.
The operation shown below is executed after the CPU 32 develops the operation program read from the program memory 34 in the main memory 33 as described above. The operation program and the like stored in the program memory 34 are not only those stored in the program memory 34 at the time of shipment of the digital signage 10, but also install a version upgrade program after the user purchases the digital signage 10. Including the contents.

  FIG. 5 is a flowchart showing the processing contents of the projection operation with visible light communication, which is executed by the CPU 32 when the digital signage 10 is actually used by installing it at a store, for example. The user of the digital signage 10 at the beginning of the process accepts selection of advertising image data stored in the memory card attached to the memory card attachment part IP (step S101).

Along with this selection operation, a guide image indicating that an information providing service using visible light communication is performed, for example, a character guide message
"If you want to use visible light communication, hold your smartphone's camera over the edge of the panel."
The image data is created by superimposing the above image at an arbitrary position of the selected image (step S102).

  Thereafter, the CPU 32 temporarily displays the test image data read from the program memory 34 on the micromirror element 22 and projects the test image on the signage board SB (step S103), and then the imaging unit IM. Then, the projected image range including the signage board SB is photographed, and the photographed image processing unit 30 extracts the test image pattern from the photographed image, thereby recognizing the shape of the signage board SB in the projection area at that time (step) S104).

  After preparing the above processing in advance, the CPU 32 starts a normal projection operation on the signage board SB using the image data created in step S102 (step S105).

  Then, the CPU 32 starts a shooting operation at the imaging unit IM (step S106). The CPU 32 waits for recognition of the shape of the image around the signage board SB until the viewer's smartphone or the like, which is a communication object of visible light communication, appears in the captured image (step S107).

  When the shape of the object for visible light communication is recognized, the CPU 32 determines the appearance of step S107, and the content information for visible light communication stored in association with the image data set at that time. Is read by the memory card mounting unit IP, and in accordance with the normal projection operation on the signage board SB, the projected pixels at the peripheral edge of the image projected on the signage board SB are used, and the content information is superimposed on the visible light communication. The transmission operation is started (step S108).

  FIG. 6 shows a state where the CPU 32 recognizes the shape of the signage board SB within the rectangular projectable area PA and projects an image as the screen projection area SA. In addition, in the present embodiment, the read content is maintained while maintaining the gradation value projected by each pixel with respect to the peripheral portion RM of the screen projection area SA, for example, a predetermined number of pixels width such as 20 pixels from the outer peripheral edge. Control is performed so as to be a blinking pattern of visible light communication according to information.

  Details of the information transmitted at the pixel position where the visible light communication of the micromirror element 22 is performed at this time are described in the JEITA CP-12121 / 1222 standard, the ARIB STD-T50 standard, etc. Omitted.

  Therefore, the viewer simply holds the signage board SB on the signage board SB just by holding the camera part such as a smartphone in which an application program corresponding to visible light communication is installed in advance as shown in the initial guide display. By directly receiving the minute light leaking from the side of the board by diffraction from the peripheral edge, it is possible to receive data by visible light communication.

  In this case, the projection light emitted from the surface of the signage board SB to the viewer side through the rear project screen 14 and the transparent board 15 constituting the signage board SB described above has a particularly large amount of diffuse reflection components on the rear project screen 14. Therefore, it is not suitable for data reception as visible light communication.

  On the other hand, the weak leaking light of about 1% of the projected light leaking from the side peripheral surface of the signage board SB due to the diffracted light is not affected by the irregular reflection on the rear project screen 14 and is visible light communication. Data quality can be maintained.

  Therefore, while reliably avoiding a situation in which the projection light comes off the signage board SB and is directly viewed with the naked eye, the communication object receiving unit is arranged to face the peripheral portion RM of the screen projection area SA. By directing, data distribution by visible light communication becomes possible.

  While maintaining the data distribution state by the visible light communication, the CPU 32 continues to recognize the shape of the communication object in the projection area of the signage board SB, and repeatedly determines that the communication object of the visible light communication is not lost, It waits until the end timing of visible light communication is reached (step S109).

  Then, when the device to be communicated cannot be recognized from the captured image, the CPU 32 determines that the communication object for visible light communication has disappeared, and ends the data transmission in the communication projection area TA. (Step S110).

  Thereafter, the CPU 32 determines whether or not an operation for terminating the projection itself in the digital signage 10 has been performed based on whether or not the power key is operated on the operation unit 35 (step S111). If it is determined in step S111 that the operation for ending the projection is not performed, the CPU 32 returns to the process from step S105 and continues the normal projection operation.

  If it is determined in step S111 that the operation for ending the projection has been performed with the power key, the CPU 32 ends the projection operation in FIG.

  As described above in detail, according to the present embodiment, when an image is projected onto an irregular screen, leakage light from a peripheral edge that is not originally used for projection is effectively utilized while ensuring sufficient safety. It is possible to further improve the appeal as an electronic signboard.

  In this case, it becomes easier to use by presenting to the viewer a position where leakage light from the periphery can be used by the guide image.

  Further, in the above-described embodiment, the imaging unit IM that covers and captures an area that can be projected by the projection lens unit 25 is provided, and the position of the device that is a communication target can be recognized as long as it is around the signage board SB within the projection area. As a result, it is possible to realize an environment in which the viewer has a high degree of freedom and can more easily cooperate with the provision of information services.

  In the above embodiment, as shown in FIG. 6, it has been described that visible light communication is performed over the entire periphery RM except for the lower end of the screen projection area SA. However, the communication rate is low, and blinking for data communication is visually observed. In the case where it can be visually recognized, data transmission may be limited to only the part where the device to be communicated exists in the peripheral portion of the screen projection area SA.

  In this way, by limiting the area where the degradation of the image quality of the projected image due to visible light communication can be visually recognized, unnatural depiction for viewers other than the viewer performing visible light communication is avoided, and the effect as an electronic signboard Can be maintained.

  In the above-described embodiment, it has been described that the data is unilaterally transmitted from the digital signage 10 and the provided information is received by a device that is a communication target such as a smartphone that the viewer has, For example, in the case of a smartphone, since an LED for photographing target illumination is provided near the camera unit, data transmission by visible light communication from the communication target side can be performed by the LED. Accordingly, it is possible to realize a bidirectional communication environment and collect information within a range that can be used as information on the viewer side, for example, personal information.

  In addition, although the said embodiment demonstrated the case where it applied to the digital signage by the DLP (trademark) type rear projection, this invention is not limited to this, The projection direction of the display element which forms an optical image, front / rear, It is not intended to limit the use of the apparatus as a moving image and still image to be handled.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

Hereinafter, the invention described in the scope of claims of the present application will be appended.
According to a first aspect of the present invention, there is provided projection means for projecting an image, shape acquisition means for acquiring a shape of a screen for projecting an image by the projection means, and projection according to the shape of the screen acquired by the shape acquisition means. A first projection control means for projecting an image using a part of a projectable area by the means, a determination means for determining whether or not there is a communication object in the vicinity of the periphery of the screen, and a determination result by the determination means And a second projection control unit that causes the projection unit to execute visible light data transmission using the periphery of the image with respect to a communication target in the vicinity of the periphery of the screen.

  According to a second aspect of the present invention, in the first aspect of the invention, the first projection control unit causes the guide image that prompts the communication object to approach the periphery of the image to be superimposed and projected. It is characterized by.

  According to a third aspect of the present invention, in the first or second aspect of the present invention, the image forming apparatus further includes photographing means for photographing a projection range by the projecting means, and the determining means is based on an image of the projection range obtained by the photographing means. The presence or absence of a communication target in an area outside the screen is determined.

According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the determination unit determines a position of the communication target, and the second projection control unit is obtained by the determination unit. Visible light data is transmitted using a part of the periphery of the image according to the position of the communication target.

  The invention according to claim 5 is a projection control method in an apparatus including a projection unit that projects an image, the shape obtaining step for obtaining the shape of a screen on which the image is projected by the projection unit, and the shape obtaining step. The first projection control step of projecting an image using a part of the projectable area by the projection unit according to the shape of the screen acquired in step 1, and determining whether there is a communication target in the vicinity of the periphery of the screen And a second projection control step of executing visible light data transmission by the projection unit using the peripheral edge of the image with respect to a communication target in the vicinity of the peripheral edge of the screen according to the determination result in the determination step. It is characterized by having.

  The invention according to claim 6 is a program executed by a computer built in an apparatus having a projection unit for projecting an image, wherein the computer acquires a shape of a screen for projecting an image by the projection unit. Means, a first projection control means for projecting an image using a part of a region that can be projected by the projection unit according to the shape of the screen acquired by the shape acquisition means, is there a communication object in the vicinity of the periphery of the screen? A determination unit configured to determine whether or not, and according to a determination result of the determination unit, the projection unit performs visible light data transmission using the periphery of the image with respect to a communication target in the vicinity of the periphery of the screen. It is characterized by functioning as a second projection control means.

  DESCRIPTION OF SYMBOLS 10 ... Digital signage, 10A ... Apparatus housing, 11 ... Projection lens barrel, 12 ... Total reflection mirror, 13 ... Fresnel lens sheet, 14 ... Rear project screen, 15 ... Transparent board, 21 ... Projection image drive part, 22 ... Micromirror element, 23 ... light source, 24 ... mirror, 25 ... projection lens, 26 ... lens motor (M), 27 ... photographing lens, 28 ... CMOS image sensor, 29 ... A / D converter, 30 ... photographing Image processing unit 31 ... Lens motor (M) 32 ... CPU 33 ... Main memory 34 ... Program memory 35 ... Operation unit 36 ... Audio processing unit 37 ... Speaker unit B ... System bus B1-B4 ... operation buttons, IM ... imaging part, IP ... memory card mounting part, PA ... projection possible area, RM ... peripheral part, SA ... screen projection area, SB ... size Jibodo.

Claims (6)

Projection means for projecting an image;
Shape acquisition means for acquiring the shape of a screen for projecting an image by the projection means;
First projection control means for projecting an image using a part of a projectable area by the projection means according to the shape of the screen acquired by the shape acquisition means;
Determining means for determining whether there is a communication object in the vicinity of the periphery of the screen;
A second projection control unit configured to cause the projection unit to execute visible light data transmission using the periphery of the image with respect to a communication target in the vicinity of the periphery of the screen according to a determination result of the determination unit. A projection apparatus characterized by that.   The projection apparatus according to claim 1, wherein the first projection control unit superimposes and projects a guide image that prompts the communication target to approach the periphery of the image. Further comprising an imaging means for imaging the projection range by the projection means,
The projection apparatus according to claim 1, wherein the determination unit determines whether or not there is a communication target in an area outside the screen from an image in a projection range obtained by the photographing unit. The determination means determines the position of the communication target,
The second projection control unit causes the visible light data to be transmitted using a part of the periphery of the image according to the position of the communication target obtained by the determination unit. Any one of the projection apparatuses. A projection control method in an apparatus including a projection unit that projects an image,
A shape acquisition step of acquiring a shape of a screen for projecting an image by the projection unit;
A first projection control step of projecting an image using a part of a projectable region by the projection unit according to the shape of the screen acquired in the shape acquisition step;
A determination step of determining whether there is a communication target in the vicinity of the periphery of the screen;
A second projection control step in which visible light data transmission is performed by the projection unit using the periphery of the image with respect to a communication target in the vicinity of the periphery of the screen according to a determination result in the determination step. A projection control method characterized by the above. A program executed by a computer built in an apparatus having a projection unit for projecting an image, the computer being
Shape acquisition means for acquiring a shape of a screen for projecting an image by the projection unit;
First projection control means for projecting an image using a part of a projectable area by the projection unit according to the shape of the screen acquired by the shape acquisition means;
Determining means for determining whether or not there is a communication object in the vicinity of the periphery of the screen; and the periphery of the image by the projection unit with respect to a communication object in the vicinity of the periphery of the screen according to a determination result in the determination means A program that functions as a second projection control unit that executes visible light data transmission using a computer.

Images