JP2016038876A - Image input device, image output device, and image input/output system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To input an image in freely selected size with high operability on a portable apparatus side, and easily reflect and display the input image on a large screen.SOLUTION: A display device includes: an antenna 11 and a radio communication part 12 that receive information on an image transmitted from an input device and information on an input area; and a CPU 20 that projects, with projection systems 13 to 17, an image having the information on the image arranged in an area according to the information on the input area, of the entire input area, on the basis of the received information on the image and information on the input area.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image input device, an image output device, and an image input / output system suitable for, for example, shared use of draw software.

  Application programs for smartphones that are connected to a projector apparatus and perform drawing on a projection screen emitted from the projector apparatus have been put into practical use. In this type of program, the display on the smartphone side has a one-to-one correspondence with the projected image of the projector. When a drawing operation is performed on the smartphone display by a touch operation, the ratio of the drawing content on the display is set. Correspondingly, the drawing content is reproduced on the projection image of the projector.

  In addition to the application program described above, there has been proposed a technology that realizes vertical and horizontal scrolling by button operation in an electronic blackboard application system that directly draws with a pen device on a large display (for example, Patent Documents). 1).

JP 2002-268617 A

  In the above-described general smartphone application program, the projection screen of the projector device and the drawing range on the display of the smartphone correspond to each other on a one-to-one basis. When you try to input a character by hand, there is a difference in absolute projection / input area, so you must perform very fine writing with your fingers on the smartphone display, and the size of characters that can be input. There is a limit.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide an image on a device that performs display on a large screen and, for example, a portable device in which a touch input unit and a display unit are integrated. In a system that can input any image in the image by sharing the image, input the image in an arbitrary size with high operability on the mobile device side, and easily reflect the input image on the large screen An object of the present invention is to provide an image input device, an image output device, an image authentication system, and a program that can be displayed.

  One aspect of the present invention is a display unit that displays an input area of an image, an instruction unit that instructs an input area to be displayed on the display unit, an input unit that inputs an image for the input area displayed on the display unit, A transmission unit configured to transmit information on an image input by the input unit and information on an input area instructed by the instruction unit.

  According to the present invention, in a system that can display an image on a large screen and, for example, a portable device in which a touch input unit and a display unit are integrated, and can input an arbitrary image in the image. In addition, it is possible to input an image with an arbitrary size due to high operability on the portable device side, and to easily display the input image on a large screen.

1 is a diagram illustrating a configuration of an entire image system according to an embodiment of the present invention. FIG. 2 is a block diagram showing a functional configuration of an electronic circuit of the projector device according to the embodiment. 6 is an exemplary flowchart illustrating a part of main processes in a shared draw application executed on the projector device side according to the embodiment. The figure which shows the transition of the input range in the smart phone which concerns on the same embodiment, and the input range projected on a screen. The figure which shows the transition of the input range in the smart phone which concerns on the same embodiment, and the input range projected on a screen.

  Hereinafter, an embodiment in which the present invention is applied to a draw system using a smartphone and a projector device will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing the configuration of the entire system. In the figure, a plurality of, for example, two smartphones SP1 and SP2 are wirelessly connected to the projector device PJ by Bluetooth (registered trademark) which is a short-range wireless communication technology.

  The smartphones SP1 and SP2 and the projector device PJ respectively function as smartphones SP1 and SP2 as image input devices and the projector device PJ as a display device according to a preinstalled shared draw application (program). The image data is input when the user performs a drawing operation on the touch panel with fingers, and the image data is reflected on the image projected by the projector device PJ.

  FIG. 1 shows an initial state of the shared draw application. The image projected onto the screen SC by the projector device PJ is a rectangular ruled line image indicating the entire input area, and the cursor C is arranged at the uppermost left end thereof.

At this time, since the projector device PJ wirelessly transmits image data having exactly the same content as the image data projected on the screen SC to the smartphones SP1 and SP2 with the image size reduced, the display of the smartphones SP1 and SP2 The same image as the screen SC is displayed.
Note that the hardware circuit configuration of the smartphones SP1 and SP2 is the same as that of a very general one, and illustration and description thereof are omitted.

  FIG. 2 mainly explains the functional configuration of the electronic circuit of the projector device PJ. In the figure, as a wireless communication technology, for example, as described above, it corresponds to a short-range wireless communication system compliant with Bluetooth (registered trademark), and the pairing setting between the projector device PJ and the smartphones SP1 and SP2 has been completed. And The image data indicating the input area is transmitted from the wireless communication unit 12 to the smartphones SP1 and SP2 via the antenna 11, and communication data created by a drawing operation on the smartphones SP1 and SP2 uses the antenna 11. And received by the wireless communication unit 12. The wireless communication unit 12 demodulates the received data and separates it into image data and other control data. The obtained image data is stored in an image memory 24 described later, and is sent to the projection image drive unit 13 via the bus B.

  The projection image drive unit 13 multiplies a frame rate according to a predetermined format, for example, 120 [frames / second], the number of color component divisions, and the number of display gradations according to the transmitted image data. The micromirror element 14 that is a display element is driven to display by high-speed time-division driving.

  The micromirror element 14 is reflected by performing a display operation by individually turning on / off each tilt angle of a plurality of micromirrors arranged in an array, for example, 1600 horizontal x 1200 vertical, at high speed. An optical image is formed by light.

  On the other hand, R, G, and B primary color lights are emitted cyclically from the light source unit 15 in a time-sharing manner. The light source unit 15 includes an LED which is a semiconductor light emitting element, and repeatedly emits R, G, and B primary color lights in a time-sharing manner. The LED included in the light source unit 15 may include an LD (semiconductor laser) or an organic EL element as an LED in a broad sense.

  Moreover, it is good also as what uses the primary color light from which a wavelength differs from the original light excited by irradiating the light radiate | emitted from LED to a fluorescent substance. The primary color light from the light source unit 15 is totally reflected by the mirror 16 and applied to the micromirror element 14.

  Then, an optical image is formed by the reflected light from the micromirror element 14, and the formed optical image is projected onto the screen SC via the projection lens unit 17.

  Also, sound data such as sound effects used in the shared draw application is transmitted to the sound processing unit 18 via the bus B. The sound processing unit 18 includes a sound source circuit such as a PCM sound source, and reproduces a sound signal such as a beep sound in the application based on the transmitted sound data, and emits sound from the speaker units 19L and 19R. .

  The CPU 20 controls all the operations of the above circuits. The CPU 20 is directly connected to the main memory 21 and the program memory 22. The main memory 21 is composed of, for example, an SRAM and functions as a work memory for the CPU 20. The program memory 22 is configured by an electrically rewritable nonvolatile memory such as a flash ROM, and stores an operation program executed by the CPU 20 including the shared draw application, various fixed data, and the like.

  The CPU 20 controls the projector device PJ in an integrated manner by reading out the program, fixed data, and the like stored in the program memory 22, developing and storing them in the main memory 21, and executing the program. .

  The CPU 20 executes various projection operations in response to operation signals from the operation unit 23. The operation unit 23 includes a key input unit provided in the main body of the projector device PJ, a remote controller (not shown) of the projector device PJ, and a reception unit that receives the operation signal. Send to CPU20.

The CPU 20 is further connected to the image memory 24 and the input unit 25 via the bus B.
The image memory 24 stores image data indicating an input area in the shared draw application, image data created by drawing operations on the smartphones SP1 and SP2, and the like, and reads them to the projection image drive unit 13 as necessary. .
The input unit 25 inputs image data or the like input from a non-illustrated external device by wire connection here, executes processing such as A / D conversion and scaling as necessary, and drives the obtained image data to the projection image drive To the unit 13.

Next, the operation of the above embodiment will be described.
In the present embodiment, the smartphones SP1 and SP2 that are input devices only detect a touch operation on a touch panel integrated with a display, and sequentially transmit the detected coordinate value string information to the projector device PJ side.

  Note that the smartphones SP1 and SP2 correspond to a multi-touch operation in which a touch operation is simultaneously performed with a plurality of fingers on the touch panel.

  In the projector device PJ, processing related to the input area displayed on the smartphones SP1 and SP2 and processing related to drawing are performed in an integrated manner in response to touch operations on the smartphones SP1 and SP2, and the drawing contents are displayed on the projection image on the screen SC. On the other hand, image data reflecting drawing contents and the like in the input area is created and transmitted to the smartphones SP1 and SP2, respectively, and displayed on those displays.

  FIG. 3 shows an extracted part of main processes in the shared draw application executed by the CPU 20 in the projector apparatus PJ. Initially, the CPU 20 acquires coordinate value string information of the touch operation from the smartphones SP1 and SP2 via the antenna 11 and the wireless communication unit 12 at a fixed period (step S101). Then, from the content of the acquired coordinate value string information, whether or not the operation is a pinch-in / out operation by a two-finger operation (step S102), whether or not the operation is a two-finger swipe operation (step S103), one It is sequentially determined whether or not it is a finger swipe operation (step S104), and when it is determined that it is neither of them, the touch operation is invalidated and the process returns to step S101 again.

  Thus, in the process of repeatedly executing the processes of steps S101 to S104, the process waits for any touch operation on the smartphones SP1 and SP2.

  FIG. 4A shows an initial state of the shared draw application shown in FIG. In the image projected by the projector device PJ onto the screen SC, a rectangular ruled line image indicating the entire input area is formed, and the cursor C is arranged at the uppermost left end portion thereof.

  At this time, the smartphone SP1 also displays the same image as the screen SC by receiving the image data from the projector device PJ.

  Here, for example, when the user of the smartphone SP1 performs a two-finger pinch-out operation (an operation in which the touch operation positions are separated from each other) that enlarges a part of the display using the touch panel, the projector device PJ performs the above steps. In S102, it is determined that the operation has been performed, and the reduction / enlargement ratio is calculated from the operation amount, that is, the coordinate positions of the two fingers at the beginning of the operation and the coordinate positions of the two fingers at the end of the operation. Calculate (step S105).

  In this case, since it is a pinch-out operation and the operation is performed to spread two fingers, the enlargement ratio is calculated based on the ratio of the operation strokes.

  At the same time, the CPU 20 of the projector device PJ specifies the position that becomes the center of reduction / enlargement based on the center coordinates of the two fingers at the beginning of the operation, and takes the above reduction / enlargement ratio into consideration and then reduces the smartphone after reduction / enlargement The input range to be displayed at SP1 and SP2 is calculated (step S106).

  For example, when the smartphone SP1 performs a pinch-out operation with two fingers near the upper left end of the input range, the CPU 20 moves the cursor up to that point in the image projected on the screen SC as shown in FIG. Instead of C, the input range AR1 on the smartphone SP1 corresponding to the operation amount in the pinch-out operation is identified and projected on the upper left corner in the projected image so that, for example, a rectangular broken line range blinks (step S107). .

  At the same time, the CPU 20 creates new image data such that the input range AR1 is displayed over the entire display area of the smartphone SP1, transmits it to the smartphone SP1, and displays it on the display (step S108). Then, the process for the pinch-out operation is finished, and the process returns to the above-described step S101 again to prepare for the next operation.

  Thereafter, when the smartphone SP1 performs a two-finger swipe operation (an operation in which the touch operation position moves in parallel) such that the display is traced in one direction on the touch panel, the projector device PJ performs the operation in step S103. It is determined that there has been an operation, and the direction and amount of movement are calculated from the operation amount, that is, the coordinate positions of the two fingers at the beginning of the operation and the coordinate positions of the two fingers at the end of the operation. (Step S109).

  Then, the movement position of the input range AR1 in the entire input area is calculated according to the calculated direction and amount of movement (step S110).

  For example, from the state of FIG. 4B, when the smartphone SP1 performs a swipe operation in the lower right direction with two fingers, the CPU 20 displays an image projected on the screen SC as shown in FIG. 4C. Thus, the position of the input range AR1 is moved to the lower right from the previous position (step S111).

  At the same time, the CPU 20 creates image data of the new input range AR1 that has been moved, transmits it to the smartphone SP1 and displays it on the display (step S112), and the processing for the swipe operation with two fingers is completed. In order to prepare for the next operation, the process returns to step S101.

  Furthermore, when the smartphone SP1 performs a swipe operation with one finger (an operation in which the touch operation position is arbitrarily moved) such that an arbitrary drawing is performed within the range displayed by the touch panel, the projector device PJ In step S104, it is determined that the operation has been performed, and information on a coordinate value string obtained by the operation is acquired (step S113).

  Then, the drawing data to be projected in the input range AR1 according to the information of the acquired coordinate value sequence and the drawing condition information such as the type of drawing line, the thickness of the line, and the color set at that time point. Create (step S114).

  For example, from the state shown in FIG. 4C, when the smartphone SP1 performs a swipe operation such as writing hiragana “a” with one finger, the CPU 20 projects the image onto the screen SC as shown in FIG. 5A. In the image to be drawn, the drawing data “A” corresponding to the operation is projected within the input range AR1 (step S115).

  At the same time, the CPU 20 creates new image data of the input range AR1 reflecting the drawn contents, transmits the image data to the smartphone SP1 and displays it on the display (step S116), and the swipe operation with one finger as described above. After finishing the process for drawing, the process returns to step S101 again to prepare for the next operation.

  The touch operation on the smartphone SP1 side has been mainly described above as a specific example, but it goes without saying that the same touch operation can be performed on one smartphone SP2.

  FIG. 5B shows the drawing data “A” corresponding to the operation in the input range AR2 in a state where the input range AR2 is moved to the lower right of the entire input range by the touch operation on the smartphone SP2. The projected state is illustrated.

  The sizes and positions of the input ranges AR1 and AR2 can be arbitrarily operated by the respective smartphones SP1 and SP2, and the input ranges AR1 and AR2 may overlap in the entire input range.

  As described above in detail, according to the present embodiment, an image is shared between the projector device PJ that displays a large screen and the smartphones SP1 and SP2 in which the touch input unit and the display unit are integrated. It is possible to construct a system that can perform input, input an image with an arbitrary size by the high operability on the smartphones SP1 and SP2, and easily display the input image on a large screen. .

  In the above embodiment, since the input range reduction / enlargement is instructed by a form different from the swipe operation for drawing, for example, a pinch-in / out operation, an information terminal using a touch panel such as a daily smartphone is used. The input range can be reduced / expanded by a very natural operation.

  Furthermore, in the above embodiment, the movement of the input range is instructed by a form different from the swipe operation for drawing, for example, the swipe operation with two fingers, so this is also an information terminal using a touch panel such as a daily smartphone The movement of the input range can be realized by a very natural operation for the person using the.

  Moreover, in the said embodiment, since the input area in smart phone SP1, SP2 shall be projected as input range AR1, AR2 in the image which projector apparatus PJ projects on the screen SC, the user of smart phone SP1, SP2 is the whole. In this input area, the position and size occupied by the input area displayed on the own apparatus can be appropriately determined from the projection contents, and can be utilized for the contents to be drawn.

  In particular, in the present embodiment, since a plurality of, for example, two smartphones SP1 and SP2 can perform drawing together in an image projected by one projector device PJ, for example, a participant can use a smartphone or tablet. It can be applied to a wide range of applications according to the usage environment, such as reflecting on the large display that shares the individual drawing contents in a meeting with the information terminal device.

  In addition, although demonstrated here in the example of the shared draw application which can perform drawing using two smart phone SP1, SP2, this invention is applicable also when using three or more smart phones. It goes without saying that it can also be applied to a draw application that supports only one smartphone.

  In the above embodiment, the case where the projector apparatus PJ is used as an apparatus for displaying (projecting) a large shared image has been described as an example, but the present invention is not limited to this. However, using a device that is premised on projecting an image on a large screen, such as the projector device PJ, is particularly effective in constructing a system in which a plurality of images are mixed and shared. .

  Moreover, although the case where each user inputs drawing data by using a smartphone as an input device has been described in the above embodiment, the present invention is not limited to this, and text data is input as an image by a mobile phone terminal (feature phone). In addition, the present invention can be similarly applied to a usage method in which an image photographed by a digital camera is pasted on a large shared area.

  Similarly, the projector device PJ and the smartphones SP1 and SP2 have been described as being wirelessly connected by, for example, Bluetooth (registered trademark) technology, which is a short-range wireless communication technology. However, when the wireless connection is established by Wi-Fi communication, the input device The means for connecting the display device to the display device is not limited to wireless communication, and can be easily realized by a wired LAN connection such as the widely used Ethernet (registered trademark).

  In the above embodiment, as the shared draw application, only the touch operation and the partial display of the input result are performed on the smartphones SP1 and SP2 which are the input devices, and the content of the touch operation on the projector device PJ side which is the display device is displayed. Although most of the processing steps such as judgment, variable setting of input area, creation of drawing data, etc. are borne, an application program is constructed such as creating image data on the input device side and sending it to the display device side. It is assumed that how the processing burden of each device is distributed can be arbitrarily set.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

Hereinafter, the invention described in the scope of claims of the present application will be appended.
The invention described in claim 1 is a display means for displaying an input area of an image, an instruction means for instructing an input area to be displayed by the display means, and an input means for inputting an image for the input area to be displayed by the display means. And transmitting means for transmitting information on the image input by the input means and information on the input area specified by the instruction means.
According to a second aspect of the present invention, in the first aspect of the present invention, the input means inputs information about an image to be drawn by a touch operation on an input area displayed by the display means, and the instruction means It is characterized in that at least one of enlargement, reduction and position of the input area displayed by the display means is instructed by a touch operation of a form different from the touch operation at the means.
According to a third aspect of the present invention, in the first aspect of the present invention, the input means inputs image information to be drawn by a touch operation on an input area displayed by the display means, and the touch operation by the input means is performed. The display unit further includes a designation unit that designates movement of the input area displayed by the display unit by a touch operation of a different form.
According to a fourth aspect of the present invention, there is provided a display device that cooperates with the input device according to any one of the first to third aspects, wherein the image information and the input area information transmitted by the transmission means are received. And display control for displaying an image in which the information of the image is arranged in an area according to the information of the input area in the entire input area based on the information of the image received by the receiving means and the information of the input area Means.
The invention according to claim 5 is the invention according to claim 4, wherein the display control means also displays the range of the input area in the entire input area based on the information of the input area. And
According to a sixth aspect of the invention, in the invention of the fourth or fifth aspect, the display control means distinguishes and displays image information received from a plurality of input devices.
According to a seventh aspect of the invention, in the invention according to any one of the fourth to sixth aspects, the display control unit forms an image in which the information of the image is arranged in the entire input area as a light image, and It is characterized by projecting on.
According to an eighth aspect of the present invention, there is provided display means for displaying an input area of an image, instruction means for instructing an input area to be displayed by the display means, input means for inputting an image to the input area to be displayed by the display means, and the input An input device comprising: transmission means for transmitting image information inputted by the means and information on the input area designated by the instruction means; and receiving means for receiving image information and position information transmitted by the transmission means Display control means for displaying an image in which the information of the image is arranged in an area according to the information of the input area in the entire input area based on the information of the image received by the receiving means and the information of the input area And a display device provided.

11 ... Antenna,
12 ... wireless communication part,
13 ... projected image drive unit,
14 ... Micromirror element,
15 ... light source part,
16 ... mirror,
17 ... projection lens part,
18 ... voice processing unit,
19L, 19R ... speaker unit,
20 ... CPU,
21 ... Main memory,
22 ... Program memory,
23 ... operation unit,
24 ... Image memory,
25 ... Input section,
AR1, AR2 ... Input range (for each smartphone)
B ... Bus
PJ ... Projector device,
SC ... Screen,
SP1, SP2 ... Smartphone.

Claims (8)

Display means for displaying an image input area;
Instruction means for indicating an input area to be displayed by the display means;
Input means for inputting an image for an input area to be displayed by the display means;
Transmitting means for transmitting information on the image input by the input means and information on the input area specified by the instruction means;
An input device comprising: The input means inputs information of an image to be drawn by a touch operation on the input area displayed by the display means,
2. The instruction unit according to claim 1, wherein at least one of enlargement, reduction, and position of an input area displayed on the display unit is instructed by a touch operation different from a touch operation on the input unit. Input device. The input means inputs information of an image to be drawn by a touch operation on the input area displayed by the display means,
The input device according to claim 1, further comprising a designation unit that designates movement of an input area displayed on the display unit by a touch operation of a form different from the touch operation on the input unit. A display device that cooperates with the input device according to any one of claims 1 to 3,
Receiving means for receiving image information and input area information transmitted by the transmitting means;
Display control means for displaying an image in which the image information is arranged in an area according to the information of the input area in the entire input area based on the information of the image received by the receiving means and the information of the input area; A display device comprising:   The display device according to claim 4, wherein the display control unit displays the range of the input area in the entire input area based on the information of the input area.   The display device according to claim 4 or 5, wherein the display control means distinguishes and displays image information received from a plurality of input devices.   7. The display device according to claim 4, wherein the display control unit forms an image in which information of the image is arranged in the entire input area as a light image and projects the image outside the device. Display means for displaying an input area of an image, instruction means for instructing an input area to be displayed by the display means, input means for inputting an image for the input area to be displayed by the display means, information of an image input by the input means, And an input device comprising: transmission means for transmitting information on the input area instructed by the instruction means;
The information of the input area in the entire input area based on the information of the image received by the receiving means, the information of the image received by the receiving means, and the information of the input area is received. A display device comprising display control means for displaying an image in which the information of the image is arranged in a conforming area;
An image input / output system comprising:

Images