JP2018055037A - Projector, and image projection method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To continuously continue work without interrupting the work (progress of a conference, presentation, or the like) using a projector even though an information processing device is brought into a screen server state while using the projector.SOLUTION: The projector for projecting a projection image outputted from the information processing device includes: image acquisition means for acquiring a projection image outputted from the information processing device; image analysis means for analyzing contents of the projection image acquired by the image acquisition means; and image switching means for determining whether to project a first projection image acquired before the analyzed projection image or to project a second projection image currently outputted from the information processing device on the basis of the contents of the projection image analyzed by the image analysis means, and switching the projection image to be projected.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a projector that projects an image received from an information processing apparatus, a projection-type image display system, an image projection method, and a program.

  When projecting information from an information processing device, etc. using a projector, if the video signal is interrupted unexpectedly due to disconnection of the connection cable with the video output device, etc., the projector's surrounding environment becomes dark and dark. Therefore, it may be inconvenient for the user to operate the buttons on the projector main body, or to find the location of the remote control or the lighting switch in the room.

In order to solve the above problems, Patent Document 1 automatically detects an unexpected situation caused by disconnection of a connection cable, and the projector measures the illuminance of the installation environment. A technology for displaying a bright plain image and using it as auxiliary illumination is disclosed.
JP 2016-33573 A

  Patent Document 1 discloses a technique of using as auxiliary illumination when the periphery is dark due to removal of a connection cable or the like. However, when the information processing apparatus changes the screen by a screen saver or the like, the screen is displayed during the meeting. The discussion is interrupted because it switches. In the example of Patent Document 1, it is prevented that the image becomes dark at the end of the meeting, such as removal of a connection cable. However, when a bright plain image is projected, the content of the meeting is interrupted.

  The present invention has been made to solve the above-described problem, and even when the information processing apparatus is in a screen saver state while the projector is in use, the operation using the projector (progress of meetings, presentations, etc.) is interrupted. It aims to be able to continue working without any problems.

  The present invention is a projector that projects a projection image output from an information processing apparatus, an image acquisition unit that acquires the projection image output from the information processing apparatus, and the content of the projection image acquired by the image acquisition unit Based on the content of the projection image analyzed by the image analysis means, the first projection image acquired before the analyzed projection image is projected, or from the information processing apparatus Image switching means for determining whether to project the second output image that is currently output and switching the projected image to be projected.

  According to the present invention, even when the information processing apparatus is in a screen saver state while using the projector, the work using the projector (progress of conferences, presentations, etc.) can be continued without being interrupted. It becomes possible.

It is a figure which shows the software structure of the projector 100 in embodiment of this invention. It is a figure which shows the hardware constitutions of the projector 100 in embodiment of this invention. It is a figure which shows an example of the hardware constitutions of the information processing apparatus applicable to the information processing apparatus 300 in embodiment of this invention. It is a flowchart explaining the projection process of the projector 100 in embodiment of this invention. FIG. 6 is a schematic diagram showing a projection plane and a screen image displayed by projector 100 and information processing apparatus 300 in the embodiment of the present invention.

  Hereinafter, a projector according to a first embodiment of the invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a software configuration of the projector 100 according to the embodiment of the present invention.

  A projector 100 in FIG. 1 includes a signal input unit 110 that inputs an image signal 170 from an information processing device 300 (described later), an information control unit 111 that controls information of the image signal 170, and a signal that outputs a control result. An output unit 112 is included.

  Further, the image processing unit 113 for instructing projection of information different from the information of the image signal 170 and the projection unit 114 for projecting information received by the image signal 170 onto the projection surface 160 are provided.

  The image processing unit 113 includes an image acquisition unit 101 that acquires image information input as the image signal 170, and the image analysis unit 102 analyzes the acquired image information.

  As a result of analysis by the image analysis unit 102, an image switching unit that switches whether the input image information is projected as it is or an image acquired before that is projected. By the processing of the image switching unit, not only the image information received from the information processing apparatus 300 is projected as it is, but also the projector is used by switching the projected image from the situation of the information processing apparatus 300 determined by the analysis of the image information. There is an effect that it is possible to continue the work without interrupting the work (progress of conference, presentation, etc.) in the middle. Details will be described later.

  The projection unit 114 includes a spatial light modulator 121, a drive unit 120 that drives the spatial light modulator 121, a light source 122, and a lens 123.

  The driving unit 120 drives the spatial light modulator 121 based on the image signal from the signal output unit 112. Then, the projection unit 114 projects the light from the light source 122 via the spatial light modulator 121 and the lens 123.

  In the present embodiment, all processing is performed in the projector 100, but the information processing apparatus 300 that transmits the image signal 170 may perform part of the processing in 113 of FIG. May go

  Next, the hardware configuration of the projector 100 shown in FIG. 1 will be described with reference to FIG.

  FIG. 2 is a diagram illustrating a hardware configuration of the projector 100 according to the embodiment of the present invention.

  The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

  In addition, the ROM 202 or the information storage medium 207 implements a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS) that is a control program of the CPU 201 and functions executed by each server or each PC. Various necessary programs to be described later are stored. The RAM 203 functions as a main memory, work area, and the like for the CPU 201.

  The CPU 201 implements various operations by loading a program necessary for execution of processing into the RAM 203 and executing the program.

  An input controller (input C) 205 controls input from the operation unit 209.

  An output controller (output C) 206 controls display on a display unit such as the projection unit 210. The display device may be a CRT or a liquid crystal display.

  The information storage medium 207 stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like.

  A communication I / F controller (communication I / FC) 208 is connected to and communicates with an external device via a network, and executes communication control processing in the network. Information communication with other information processing apparatuses, Internet communication using TCP / IP, and the like are possible.

  Note that the CPU 201 enables display on the projection unit 210 by executing, for example, an outline font rasterization process on a display information area in the RAM 203.

  A program for realizing the present invention is recorded in the information storage medium 207 and is executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, the program generated by the present invention, the proxy class file, the definition file used by the program, and various information tables are stored in the information storage medium 207, and detailed description thereof will be described later.

  The configuration in FIG. 2 is an example, and it goes without saying that there are various configuration examples depending on the application and purpose. As another configuration example, the projector can generate a program by receiving a program generation command from an information processing apparatus such as a personal computer (not shown) that is connected to a network and can communicate.

  That is, as long as the functions of the present invention are realized, the present invention can be applied to a single device, a system composed of a plurality of devices, or a system that performs processing via a network. Can be applied.

  The information stored in the information storage medium 207 may be stored in a database (DB) or the like.

  Next, an example of the hardware configuration of the information processing apparatus applicable to the information processing apparatus 300 that transmits the image signal 170 will be described with reference to FIG.

  In FIG. 3, reference numeral 301 denotes a CPU that comprehensively controls each device and controller connected to the system bus 304. Further, the ROM 303 or the external memory 311 requires a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as OS), which is a control program of the CPU 301, and a function executed by the information processing apparatus 300. Various programs to be described later are stored.

  Reference numeral 302 denotes a RAM that functions as a main memory, work area, and the like for the CPU 301. The CPU 301 implements various operations by loading a program or the like necessary for execution of processing from the ROM 303 or the external memory 311 into the RAM 302 and executing the loaded program.

  An input controller 305 controls input from an input device 309 such as a keyboard or a pointing device. A video controller 306 controls display on a display device such as the display device 310. These are used by the operator as needed.

  A memory controller 307 is connected via an adapter to a hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. The access to the external memory 311 such as a compact flash (registered trademark) memory is controlled.

  Reference numeral 308 denotes a communication I / F (interface) controller that is connected to and communicates with an external device via a network, and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 301 enables display on the display device 310 by, for example, executing outline font rasterization processing on the display information area in the RAM 302. In addition, the CPU 301 enables a user instruction with a mouse cursor (not shown) on the display device 310.

  The processing of each step shown in the flowchart to be described later for realizing the present invention may be executed by a computer readable and executable program, and the program is recorded in the external memory 311. Then, it is executed by the CPU 301 by being loaded into the RAM 302 as necessary. Furthermore, a definition file and various information tables used when executing the program may be stored in the external memory 311.

  Next, a basic processing flow of the projector 100 will be described with reference to FIGS.

  FIG. 4 is a flowchart illustrating the projection processing of the projector 100 according to the embodiment of the present invention. 4 is executed by the CPU 100 and the CPU 301 of the projector 100 and the information processing apparatus, and S401 to S422 in the figure indicate the respective processing steps.

  FIG. 5 is a schematic diagram showing a projection plane and a screen image displayed by the projector 100 and the information processing apparatus 300 according to the embodiment of the present invention. A description will be given along the procedure of the flowchart of FIG. 4 with reference to FIG.

  The flowchart of FIG. 4 is a flowchart when the projector 100 and the information processing apparatus 300 are connected and screen projection by the projector is started. The connection with the information processing apparatus 300 may be a VGA terminal, an HDMI (registered trademark) terminal, or a connection via a LAN line.

  In step S401 of the flowchart of FIG. 4, first, the CPU 301 of the information processing device 300 generates a screen image (projection information) to be projected on the projector 100. The screen image to be projected may be the same as the display unit 310 of the information processing apparatus 300 or may be generated for the projector 100. In the example of FIG. 5, an example in which an image common to the display unit 310 of the information processing device 300 is projected will be described. As a result of step S401, the screen image displayed on the display unit 310 of the information processing apparatus 300 is 501.

  The CPU 301 of the information processing device 300 transmits the generated projection information to the projector 100, and the CPU 201 of the projector 100 receives the projection information from the information processing device 300 in step S411. Subsequent processing of the projector 100 will be described later.

  Next, in step S402, the CPU 301 of the information processing apparatus 300 starts a screen saver timer. The function of this screen saver is a function that erases the displayed screen or prompts the user to log in again if there is no user operation for a predetermined time. Eliminating the screen being displayed prevents burn-in of the cathode ray tube display or plasma display, or prompts the user to log in again to prevent others from using it while the user is not using it. Can do.

  Next, in step S <b> 403, the CPU 301 of the information processing apparatus 300 confirms whether the screen information displayed on the display unit 310 has been updated. If the screen information has been updated, the screen saver function is not activated, and the process returns to step S401. On the other hand, if the screen information has not been updated, the process proceeds to step S404.

  Next, in step S404, the CPU 301 of the information processing apparatus 300 confirms whether the timer started in step S402 has passed a predetermined time. If the predetermined time has not elapsed, the process proceeds to step S403, and steps S404 and S403 are repeated while the screen information is not updated. Needless to say, the projection information is transmitted to the projector 100 until the predetermined time elapses.

  On the other hand, in step S404, when the predetermined time has elapsed in the timer started in step S402, the process proceeds to step 405.

  In step S <b> 405, the CPU 301 of the information processing device 300 transmits black screen information (information in a state where nothing is displayed) to the projector 100. An image like 504 is transmitted with the screen image of FIG.

  Next, in step S406, the CPU 301 of the information processing apparatus 300 determines whether the screen saver state has been canceled. The process of canceling the screen saver state is, for example, when a user's operation is accepted or when the user's re-login screen is displayed on the display unit 310 of the information processing apparatus 300 and the user performs an authentication operation and is authenticated. There are cases. The screen image of FIG. 5 shows an example in which a screen such as 506 is transmitted to the projector 100. The screen image to be transmitted may be a screen image such as 504 continuously.

  If it is determined in step S406 that the screen saver state has been released, the process returns to step S401. The image of the transmission screen to the projector 100 immediately after returning the process to step S401 is a screen image before entering the screen saver state as indicated by 508 in FIG. On the other hand, if the screen saver state has not been released, the process returns to step S406 to wait for the screen saver state to be released. Note that projection information (black screen information and re-login information) is transmitted to the projector 100 until the screen saver state is canceled. The above processing is performed on the information processing apparatus 300 side.

  The processing of the other projector 100 will be described below.

  The CPU 201 of the projector 100 receives the projection information transmitted from the information processing apparatus 300 in step S411.

  Next, in step S412, the CPU 201 of the projector 100 determines whether the received projection information is black screen information. When the projection information is a black screen, it is considered that the information processing device 300 is in the screen saver state, the connection with the information processing device 300 is ended, or the information processing device 300 is ended. In step S413, the CPU 201 of the projector 100 determines whether communication with the information processing apparatus 300 is possible. If communication with the information processing device 300 is possible, since the state is connected to the information processing device 300, the process proceeds to the next step S414. On the other hand, if communication with the information processing apparatus 300 is impossible, the process proceeds to step S416, and the projector 100 stops the projection process. That is, since the connection with the information processing apparatus 300 has ended or the information processing apparatus 300 has ended, a projection stop process is executed.

  When the process transitions to step S414, the CPU 201 of the projector 100 turns on the screen saver flag. The screen saver flag is a flag for identifying whether or not the information processing apparatus 300 is in the screen saver state.

  Next, in step S415, the CPU 201 of the projector 100 performs a process of projecting the projection image (projection information) separately stored in step S419. This process is a process of continuously projecting a previously stored projection image (projection information) onto the screen 160 when an image in the screen saver state is acquired from the information processing apparatus 300. This process is a process (image switching means) in which the projection information received in step S411 is not projected as in the prior art, but is switched to the projection information stored in step S419. In the projection image of FIG. 5, an image 505 is displayed, and projection information different from the received image 504 is displayed.

  Through this process, information such as black screens can be projected to prevent work from being interrupted (for example, progress of important meetings such as board meetings), and work can be continued by projecting continuous images. It has an effect that can be done.

  When the process of step S415 ends, the process returns to step S411, and the subsequent processes are repeated.

  In step S412, if it is determined that the received projection information is not black screen information, the process proceeds to step S417. If the received projection information is not black screen information, since some image is being displayed, the information processing apparatus 300 may not be in the screen saver state. Therefore, in step S417, it is determined whether the screen saver flag is ON.

  In step S417, the CPU 201 of the projector 100 divides processing depending on whether the screen saver flag is ON. If the screen saver flag is ON, the process proceeds to step S421. If the screen saver flag is not ON, the process proceeds to step S418.

  When the process transitions to step S418, the CPU 201 of the projector 100 deletes the currently stored projection image, and stores the projection image acquired in step S411 in the RAM 203 of the projector 100 in step S419. In the projection image diagram of FIG. 5, a screen image such as 503 is stored.

  Thereafter, the process proceeds to step S420, and the CPU 201 of the projector 100 projects the projection information received in step S411 on the screen 160. In the projection image diagram of FIG. 5, the projection image 501 received from the information processing apparatus 300 is projected as it is as 502. After the process of step S420, the process returns to step S411, and the subsequent processes are repeated.

  Next, a process when the screen saver flag is ON in step S417 will be described.

  If the screen saver flag is ON in step S417, the process proceeds to step S421.

  When the process proceeds to step S421, the information processing apparatus 300 transmits projection information that is in the screen saver state but is not a black screen. This pattern is, for example, the case where a screen lock release re-login screen such as 506 in FIG. 5 is transmitted or the state where the screen saver state is released.

  If the projected image of the re-login screen such as 506 is projected as it is by the projector 100, the work using the projector (progress of meetings, presentations, etc.) is interrupted halfway. Therefore, even when a re-login screen image such as 506 is received, it is necessary to continuously project the projection information that has been projected so far.

  On the other hand, even when the information processing apparatus 300 that has been in the screen saver state is released from the screen saver state, the process proceeds to step S421 (for example, when the screen transitions from 506 to 508). Therefore, step S421 performs processing for determining whether the re-login screen or the screen saver state has been canceled.

  In step S421, the CPU 201 of the projector 100 divides the determination depending on whether the projection information acquired in step S411 matches the projection information stored in step S419.

  If the projection information acquired in step S411 does not match the projection information acquired in step S419 (image image before entering the screen saver state), the re-login screen such as 506 is transmitted as the projection information acquired in step S411. Therefore, the process proceeds to step S415, and the projection information stored in step S419 is continuously projected.

  On the other hand, when the projection information acquired in step S411 matches the projection information acquired in step S419 (image image before entering the screen saver state), that is, the projection information acquired in step S411 is like 508. In the case of the image image 501 before entering the screen saver state, it indicates that the screen saver state has been released. Therefore, the process proceeds to step S422, and the screen saver flag is turned OFF.

  Thereafter, the process proceeds to step S419, and the process proceeds to a process similar to the process in which the screen saver flag is not ON.

  Note that in step S421, the screen saver state is canceled by, for example, moving the mouse pointer, inputting one character, or the like for confirming that the projection information acquired in step S411 matches the projection information stored in step S419. In view of this, it may be defined that not 90% match, but 90% or more match, for example.

  Through the above processing, even when the information processing device is in the screen saver state while using the projector, it is possible to continue working without interrupting the work using the projector (conferences, presentations, etc.). It becomes.

  In the above embodiment, the projector 100 determines that the screen saver state has been reached when black screen information is received. However, if the projector can perform more image analysis, the screen saver state is first entered from the information processing device 300. It may be determined that the screen saver state has been entered when the screen image is acquired and the image is received.

  Further, the configuration and contents of the various data described above are not limited to this, and it goes without saying that the various data and configurations are configured according to the application and purpose.

  Although one embodiment has been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, program, or recording medium, and specifically includes a plurality of devices. The present invention may be applied to a system that is configured, or may be applied to an apparatus that includes a single device.

  Although not specifically shown, information for managing a program group stored in the recording medium, for example, version information, creator, etc. is also stored, and information depending on the OS on the program reading side, for example, a program is identified and displayed. Icons may also be stored.

  Furthermore, data depending on various programs is also managed in a directory or the like. In addition, when a program or data to be installed is compressed, a program to be decompressed may be stored.

  The functions shown in the flowchart in this embodiment may be performed by a host computer by a program installed from the outside. In this case, the present invention is applied even when an information group including a program is supplied to the output device from a recording medium such as a CD-ROM, a flash memory, or an FD, or from an external recording medium via a network. Is.

  As described above, a recording medium in which a program code of software for realizing the functions of the above-described embodiments is recorded is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus is stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the program code.

  In this case, the program code itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program code constitutes the present invention.

  As a recording medium for supplying the program code, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, A silicon disk or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) or the like running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the recording medium is written in a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program represented by software for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading out a program represented by software for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention. It becomes.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Projector 101 Image acquisition part 102 Image analysis part 103 Image switching part

Claims (7)

A projector that projects a projection image output from an information processing apparatus,
Image acquisition means for acquiring a projection image output from the information processing apparatus;
Image analysis means for analyzing the content of the projection image acquired by the image acquisition means;
Based on the content of the projection image analyzed by the image analysis means, the first projection image acquired before the analyzed projection image is projected, or the second output currently output from the information processing apparatus. Image switching means for determining whether to project a projected image and switching the projected image to be projected;
A projector comprising:   When the image is switched and projected to the first projection image by the image switching means, the content of the second projection image currently output from the information processing device is the content of the first projection image. If the image analysis unit analyzes whether or not they are the same, the image switching unit switches so as to project the second projection image currently output from the information processing apparatus. The projector according to claim 1.   When the image is switched and projected to the first projection image by the image switching means, the content of the second projection image currently output from the information processing device is the content of the first projection image. The image analysis means analyzes whether or not they are the same, and the first projection image acquired before the analyzed projection image is continuously projected until it is analyzed that they are the same. The projector according to claim 1 or 2. Storage control means for controlling whether or not to store the first projection image acquired before the analyzed projection image based on the content of the analyzed projection image;
The projector according to claim 1, further comprising:   3. The determination that the image analysis unit analyzes that the first projection image and the second projection image are the same is based on whether or not a predetermined ratio is satisfied. A projector according to any one of 4 to 4. An image projection method for projecting a projection image output from an information processing apparatus,
An image acquisition step of acquiring a projection image output from the information processing apparatus;
An image analysis step of analyzing the content of the projection image acquired by the image acquisition step;
Based on the content of the projection image analyzed by the image analysis step, the first projection image acquired before the analyzed projection image is projected, or the second output currently output from the information processing apparatus An image switching step of determining whether to project a projection image and switching the projection image to be projected;
An image projection method comprising: A projector that projects the projection image output from the information processing apparatus;
Image acquisition means for acquiring a projection image output from the information processing apparatus;
Image analysis means for analyzing the content of the projection image acquired by the image acquisition means;
Based on the content of the projection image analyzed by the image analysis means, the first projection image acquired before the analyzed projection image is projected, or the second output currently output from the information processing apparatus. Image switching means for determining whether to project a projected image and switching the projected image to be projected;
A program characterized by operating as

Images