JP2017011610A - Image projection system and image projection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow speeches of participants hearing the speech of a presenter to be easily heard by the presenter and other participants when a presentation using an image projection device is to be performed.SOLUTION: In an image projection system 100, an image projection device 110 which projects a projection image 170 on a screen 160 and a plurality of image processors 130 are connected via a network 140. The image projection device 110 comprises: a recording section for recording identification information of the plurality of information processors 130 and user information in association with each other; and a control section for giving an output request of sound data to the selected information processor 130 among the plurality of information processors 130 and outputting the sound data received from the selected information processor 130 from a sound output section. The information processor 130 includes: a sound collection section for collecting sound; and a control section for validating the sound collection section when the output request is received and transmitting the sound-collected sound data to the image projection device 110.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image projection system and an image projection apparatus.

  Projectors widely known as image projection devices are widely used for presentations, conferences, lectures, educational sites, signage, etc. for large numbers of people, and with higher resolution of liquid crystal panels and higher efficiency of lamps Improvements in brightness and price reduction are advancing.

  In addition, DLP (Digital Light Processing) type image projection apparatuses using DMD (Digital Micro-mirror Device) are widely used, and these image projection apparatuses are widely used not only in offices and schools but also at home. ing. In addition, development of a short focus type image projection apparatus in which a projection distance to a projection surface such as a screen is shortened.

  As a technique used for a presentation or a meeting using an image projection apparatus, Patent Document 1 collects audio data for the purpose of recording the content of the speech of a presenter who gives a presentation or a participant who listens to it. And a microphone as a sound collecting unit for operating the projector to operate in conjunction with the projection unit, and to project video data to be projected by the projection unit and audio data that is an explanation of the presenter and comments of the participant on the video. In addition, a projector for recording using a recording unit is disclosed.

  In the technique of Patent Document 1, when the presenter and the participant are separated from each other, when the participant asks a question or an opinion on the content of the presentation, the image from the participant is usually provided near the presenter. There is a problem that it is difficult to record the speech from the participant without reaching the sound collection unit of the projection apparatus.

  The present invention is not limited to the purpose of recording the content of speech by the image projection device. When the presenter and the participant are separated from each other, the presenter usually makes a speech using a loudspeaker such as a microphone. , Participants can hear the presenter's remarks, but when participants ask questions, presenters and participants who are in the vicinity of the participants can hear the contents of the questions, etc. May be difficult to hear. In addition, at this time, it is troublesome to give a loudspeaker to a participant each time to speak.

  In addition, even if the participant speaks at a sufficient volume, if another participant in the vicinity of the speaking participant is talking or the like, the participant's speech may be difficult to hear.

  Accordingly, the present invention provides an image projection system that makes it easy for a presenter and other participants to hear the remarks of a participant who listens to the remarks of a presenter when performing a presentation or the like using an image projecting device. The purpose is to provide.

  In order to achieve the above object, an image projection system according to the present invention is an image projection system in which a projection image is projected onto a projection surface and a plurality of information processing apparatuses are connected via a network. An image projection device records audio data to an information processing device selected from the plurality of information processing devices and a recording unit that records identification information and user information of the plurality of information processing devices in association with each other. A control unit that makes an output request and outputs audio data received from the selected information processing device from an audio output unit, wherein the information processing device collects sound and outputs the sound A control unit for enabling the sound collection unit and transmitting the sound data collected by the sound collection unit to the image projection device when receiving a request.

  ADVANTAGE OF THE INVENTION According to this invention, when performing the presentation using an image projector, etc., the speech of the participant who listens to the speech of a presenter can make it easy to hear a presenter and other participants.

It is a schematic block diagram which shows an example of an image projection system. It is a block diagram which shows the structure of an image projector. It is an example of the selection screen of information processing apparatus. It is an example of a display screen during voice reception from the information processing apparatus. It is a block diagram which shows the structure of information processing apparatus. 1 is an external view of an information processing apparatus. It is a flowchart which shows an example of the audio | voice output process by an image projector. It is a flowchart which shows an example of the audio | voice output process by information processing apparatus.

  Hereinafter, the configuration according to the present invention will be described in detail based on the embodiment shown in FIGS.

  The image projection system according to the present embodiment includes an image projection device (image projection device 110) that projects a projection image (projection image 170) on a projection surface (screen 160), and a plurality of information processing devices (information processing device 130). An image projection system (image projection system 100) connected via a network (network 140), in which the image projection apparatus records recording information (identification information of a plurality of information processing apparatuses and user information in association with each other). The NVRAM 14) and an information processing device selected from the plurality of information processing devices are requested to output audio data, and the audio data received from the selected information processing device is output to an audio output unit (audio output unit). 22) and a control unit (main control unit 10, video / audio processing unit 21, network control unit 40) to output information from When receiving an output request, a sound collection unit (sound collection unit 137) that collects sound, and the sound device enables the sound collection unit and the sound data collected by the sound collection unit to the image projection device. And a control unit (audio data output request receiving unit 138, audio compressed data transmitting unit 139) for transmission. In addition, the code | symbol in embodiment and the example of application are shown in a parenthesis.

(Image projection system configuration)
FIG. 1 is a schematic configuration diagram illustrating an example of an image projection system 100. The image projection system 100 includes an image projection device (projector) 110, a video supply device 120, and a plurality of information processing devices 130 (hereinafter also referred to as PCs).

  The image projection device 110 and the plurality of information processing devices 130 are connected to a network 140. The network 140 is, for example, a wired and / or wireless LAN network. The image projection device 110 and the plurality of information processing devices 130 are connected to the network 140 via a LAN cable 141 or a wireless LAN 142.

  The image projector 110 and the video supply device 120 are connected by a cable 150. Further, a projection image 170 is projected from the image projection device 110 onto the screen 160.

  In the present embodiment, a presenter at a meeting, presentation, or the like refers to a projection image 170 projected from the image projection device 110 onto the screen 160 based on a video signal provided from the video supply device 120, and has a predetermined content. A presentation will be given, and a participant will listen to the presentation content from the presenter at the position where the information processing device 130 is located, and give an opinion, a question, etc. if necessary. .

  The image projection device 110 is an image output device that projects an image provided by the video supply device 120 onto a projection surface such as a screen 160. The image projecting device 110 projects an OSD screen (superimposed image) such as a menu screen that allows the user to specify various operations, together with the image provided by the video supply device 120. Note that the OSD screen can be projected even when an image is not provided from the video supply device 120.

  The image projection apparatus 110 has a VGA (Video Graphics Array) input terminal such as a D-Sub connector, an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal, an S-VIDEO terminal, and an RCA terminal as an interface for inputting a video signal. The video signal is received from the video supply device 120 via the cable 150 connected to these terminals.

  In addition, the image projection apparatus 110 may receive a video signal from the video supply apparatus 120 by wireless communication based on a wireless communication protocol such as Bluetooth (registered trademark) or WiFi (registered trademark).

  The video supply device 120 is a device that provides an image to be projected by the image projection device 110. The video supply device 120 includes an interface that outputs a video signal, and an image projection device that outputs a video signal forming a display image of the video supply device 120 at a predetermined transfer rate (for example, 30 fps (frame per second) to 60 fps). 110.

  Similarly, the video supply device 120 includes video output terminals such as a VGA output terminal, an HDMI terminal, an S-VIDEO terminal, and an RCA terminal as an interface for outputting a video signal, and via a cable 150 connected to these terminals. Can be transmitted to the image projector 110.

  Further, the video supply device 120 may transmit a video signal to the image projection device 110 by wireless communication.

  As the video supply device 120, for example, a notebook PC (information processing device) can be used, but an information processing device capable of supplying a video signal such as a desktop PC, a tablet PC, or a PDA can be employed. . In the example illustrated in FIG. 1, one video supply device 120 is connected to the image projection device 110, but the image projection device 110 can connect two or more video supply devices 120. In the present embodiment, the video supply device 120 is connected to the network 140, but may be disconnected. Further, the video supply device 120 may function as one of the plurality of information processing devices 130.

  A plurality of information processing apparatuses 130 are provided in the image projection system 100 and are connected to the network 140. The information processing apparatus 130 is an information processing apparatus such as a notebook PC, a desktop PC, a tablet PC, or a PDA.

(Configuration of image projector)
FIG. 2 is a block diagram illustrating a configuration of the image projection apparatus 110 in the image projection system 100 according to the present embodiment.

  The video input terminal unit 20 is a terminal unit connected to the video supply device 120. An HDMI terminal, a video terminal, an RGB terminal, and the like connected to the video supply device 120 with a cable 150 are provided.

  The video / audio processing unit 21 converts the input video signal into RGB digital video data and transfers it to the main control unit 10. In addition, the audio data input from the video input terminal unit 20 and the main control unit 10 is D / A converted and output to the audio output unit 22 which is an audio output unit such as a speaker.

  The main control unit 10 includes a central processing unit (CPU) 11 that is a main processor, a read only memory (ROM) 12 that stores a control program, and a memory device (for example, a memory device that temporarily stores data in each process) The control unit includes an SDRAM (Synchronous Dynamic Random Access Memory) 13, and an NVRAM (Non Volatile RAM) 14 that is a data holding memory device that records setting information and the like even when the power is turned off.

  The main control unit 10 controls the lamp driving unit 31 and the optical control unit 30 to display the RGB video data transferred from the video / audio processing unit 21. The lamp driving unit 31 controls the lamp 32 as a light source based on the control from the main control unit 10.

  The optical control unit 30 controls the optical unit 33 based on the control from the main control unit 10. The optical unit 33 includes a liquid crystal light valve, a color wheel, a DMD (Digital Micromirror Device), and the like, a mirror (reflection optical system) that reflects image light for displaying an image and an image on a screen, and an enlarging / reducing lens. (Projection optical system). The optical control unit 30 controls driving of the liquid crystal light valve, color wheel, DMD, reflection optical system, and projection optical system.

  The operation control unit 25 includes a keyboard having a plurality of keys, an LED for displaying a status, and the like. The keyboard includes a power key for turning on / off the power of the image projection apparatus 110, a menu key for performing various settings, a ↓ key, an ↑ key, a ← key, a → key, an enter key, an input key for switching an input signal, a PC A connection selection key or the like is provided. Note that video data at the time of various settings and input switching is formed by OSD processing by the main control unit 10.

  The remote control 26 as a remote control means includes a power key, menu key, ↓ key, ↑ key, ← key, → key, determination key, and key for switching each video input terminal having the same functions as the operation control unit 25. PC connection selection keys, numeric input 0-9 keys, etc. are provided. When each key is pressed, a code suitable for each key is transmitted as infrared data. In addition, when receiving a signal from the remote control 26, the operation control unit 25 notifies the main control unit 10.

  In the present embodiment, the NVRAM 14 that is a recording unit of the main control unit 10 stores identification information of the information processing apparatus 130 used by the conference participants in association with the user information of the participants. The identification information is, for example, a MAC address (Media Access Control address) assigned to the information processing apparatus main body or a communication device of the information processing apparatus, an IP address, or the like.

  The user information includes at least one of the user's name, name, and identification ID, and is, for example, the name of the participant. The identification ID is an ID for identifying a participant. In the present embodiment, an example in which the user information is the name of the participant and the identification information is the MAC address will be described.

  In this image projection system 100, when a participant makes a comment such as an opinion or a question, the presenter designates the information processing device 130 of the corresponding participant by operating the remote control 26 or the keyboard of the main body. At this time, the main control unit 10 controls the lamp driving unit 31 and the optical control unit 30 based on the key input in the operation control unit 25, and on the selection screen of the information processing apparatus 130 as shown in FIG. A PC selection screen 171 is displayed on the screen 160.

  Here, the PC selection screen 171 is overlaid on the presentation content display screen (projected image 170) explained by the presenter, but only the PC selection screen 171 may be projected.

  The PC selection screen 171 is a list of user information stored in the NVRAM 14 and identification information associated therewith. Note that the PC selection screen 171 ends when the end button 172 is selected.

  When the presenter designates a participant who speaks from the PC selection screen 171, the main control unit 10 establishes a connection to the information processing apparatus 130 designated via the network 140. Specifically, the network control unit 40 is controlled to connect to the information processing apparatus 130 having the designated MAC address.

  The network control unit 40 is a control unit that performs network connection to a designated MAC address, and outputs a voice data output request after confirming the connection. If already connected to the network, a voice data output request is made to the designated MAC address.

  The information processing apparatus 130 having the designated MAC address transmits audio data in response to the audio data output request. That is, the information processing apparatus 130 turns on the microphone (sound collecting unit 137, FIG. 5) upon receiving the voice data output request, and the user of the information processing apparatus 130 gives an opinion, It is for making a remark such as a question. The content of this statement becomes voice data. The audio data becomes compressed audio compression data at the time of transmission.

  The network control unit 40 of the image projection apparatus 110 receives the audio compression data from the information processing apparatus 130 and decompresses it. FIG. 4 is an example of a display screen that is receiving audio from the information processing apparatus 130, and audio data is being received from the information processing apparatus 130 on the display screen (projected image 170) of the presentation contents explained by the presenter The voice data reception screen 173 indicating that the above is displayed in an overlay manner. Note that the selection of the end button 174 ends the audio data reception screen 173.

  Next, the network control unit 40 sends audio data to the video / audio processing unit 21, and the video / audio processing unit 21 converts the audio data to the audio output unit 22 and outputs it.

  Further, the audio data or the audio compression data may be stored together in the storage unit of the main control unit 10 or an external storage device.

(Configuration of information processing device)
FIG. 5 shows a functional block diagram of the information processing apparatus 130. The information processing apparatus 130 includes an input unit 131 for inputting data, a display unit 132 such as a display, a communication unit 133 for performing data communication, a CPU 134 as a control unit that controls the entire apparatus, and a CPU 134. The RAM 135 is used as a work area, a storage unit 136 that stores various programs for operating the CPU 134, and a sound collection unit 137 that is a built-in or external microphone.

  The CPU 134 functions as an audio data output request receiving unit 138 and an audio compressed data transmitting unit 139.

  FIG. 6 is a schematic diagram showing an appearance of the information processing apparatus 130. The information processing apparatus 130 is a notebook PC, for example, and is connected to the network 140 via a LAN cable 141 and a router. Further, it may be connected to the network 140 by a wireless LAN interface built in the information processing apparatus 130.

  As described above, when the audio data output request receiving unit 138 controls the communication unit 133 and receives an audio data output request from the network control unit 40 of the image projection apparatus 110, the sound collecting unit 137 is turned on and audio is recorded. Make it possible.

  Then, when the designated participant who makes a question or the like makes a statement to his / her information processing apparatus 130, the voice compression data transmission unit 139 records the participant's statement from the sound collection unit 137, and the voice Data is created, and the communication unit 133 is controlled to transmit the compressed audio data obtained by compressing the audio data to the image projection apparatus 110. As the audio compression method, for example, a reversible compression audio format such as TTA (The True Audio) can be used.

(Audio output processing [image projection device side])
FIG. 7 is a flowchart illustrating an example of an audio output process performed by the image projection apparatus 110 in the image projection system 100 according to the present embodiment. In this audio output process, a participant who speaks is designated, and the process up to the audio output from the image projection apparatus 110 is executed by speaking to the information processing apparatus 130 used by the designated participant. To do.

  First, it is determined whether there is a PC connection selection key operation for designating a participant who speaks (S101). Note that the PC connection selection key operation may be performed by operating a dedicated key provided in the operation control unit 25 or the remote control 26, or may be performed by selecting an item from a menu screen.

  When it is determined that the PC connection selection key operation is not performed (S101: No), the normal display is performed and the process waits until the PC connection selection key operation is performed.

  When it is determined that the operation is a PC connection selection key operation (S101: Yes), the participant's name (user information) and the MAC address (identification information) of the information processing apparatus 130 owned are read from the NVRAM 14 (S102). ), The lamp driving unit 31 and the optical control unit 30 are controlled to display the PC selection screen 171 (FIG. 3) on the screen 160 (S103).

  Next, it is determined whether or not the information processing apparatus 130 is designated by the presenter from the PC selection screen 171 (S104).

  If the presenter does not specify the information processing apparatus 130 (S104: No) and the end button 172 is selected (S106: Yes), the PC selection screen 171 is terminated (S112), and the normal display is restored. Wait until there is next PC connection selection key operation. When the end button 172 is not selected (S106: No), it waits until there is a PC designation by the presenter.

  On the other hand, if there is a PC designation by the presenter (S104: Yes), the main control unit 10 controls the network control unit 40 to make a network connection request to the MAC address of the designated information processing device 130 (S105). .

  At this time, the main control unit 10 is provided with a T1 timer for connection, starts the T1 timer (S105), and determines whether or not connection is possible and a timeout (S107, S109). The time of each timer described below is a preset allowable time.

  If the connection is not made within the T1 time, a timeout is set (S107: No, S109: Yes), and the PC selection screen 171 is terminated (S112).

  On the other hand, if the connection is made within the time T1 (S107: Yes), the network control unit 40 notifies the main control unit 10 of the connection, and the main control unit 10 receives the connection notification and outputs the voice data to the network control unit 40. Make a start request. The network control unit 40 receives the voice data output start request and transmits a voice data output start request command to the designated MAC address of the information processing apparatus 130. (S108).

  At this time, the main control unit 10 is provided with a T2 timer before the voice data output is notified from the information processing apparatus 130 in response to the request, starts the T2 timer (S108), and determines a timeout (S110).

  If there is no voice output permission notification (S111: No) from the specified MAC address of the information processing apparatus 130 within the T2 time, a timeout is set (S110: Yes), and the PC selection screen 171 is terminated (S112).

  On the other hand, when the network control unit 40 receives a voice output enable notification from the MAC address of the information processing apparatus 130 designated within the time T2 and notifies the main control unit 10 (S111: Yes), the main control unit 10 displays the PC selection screen. 171 is ended, and a voice data reception screen 173 (FIG. 4) indicating that voice data is being received is displayed (S113).

  The network control unit 40 receives the audio compression data from the designated PC MAC address (S114), and sends the received audio compression data to the video / audio processing unit 21.

  The video / audio processing unit 21 decompresses the compressed audio data (S115), converts the audio data to the audio output unit 22 and outputs the converted data (S116).

  It is determined whether or not there is an end request from the voice data reception screen 173 (S117), and if the end button 174 is selected (S117: Yes), the main control unit 10 ends the display of the voice data reception screen 173. To do. Then, the main control unit 10 notifies the network control unit 40 of the end of audio data reception, and the network control unit 40 ends the audio data reception (S118). In addition, an end notification is transmitted to the designated MAC address of the information processing apparatus 130.

  Note that the audio compression data transmission unit 139 of the information processing apparatus 130 ends the output of the audio compression data upon receiving the end notification. Further, the end of the process is performed by transmitting an end notification to the network control unit 40 of the image projection apparatus 110 by the end operation from the input unit 131 of the information processing apparatus 130, and the network control unit 40 ends the reception of the audio data. An end notification may be sent to the main control unit 10.

(Audio output processing [information processing device side])
FIG. 8 is a flowchart illustrating an example of an audio output process by the information processing apparatus 130 in the image projection system 100 according to the present embodiment.

  First, it is determined whether there is a network connection request from the image projection apparatus 110 (S201).

  When there is no network connection request (S201: No), it waits as it is. On the other hand, if there is a network connection request (S201: Yes), a network connection is made (S202).

  At this time, a T3 timer is provided as an audio data output request reception time, and the T3 timer is started (S202), and it is determined whether an audio data output request has been received and whether a timeout has occurred (S203, S205).

  If the voice data output request cannot be received within T3 time (S203: No, S205 Yes), the network connection is terminated as a timeout (S215).

  On the other hand, when the voice data output request is received within the time T3 (S203: Yes), the built-in microphone (sound collecting unit 137) is set (S204).

  At this time, a T4 timer is provided as a built-in microphone setting time, the T4 timer is started (S204), and it is determined whether or not a microphone can be set and whether a timeout has occurred (S206, S208).

  When the setting of the built-in microphone cannot be completed within the time T4 (S206: No, S208: Yes), a notification of the audio data output failure is transmitted to the image projection apparatus 110 as a timeout (S210), and the network connection is terminated (S215). ). An example in which the built-in microphone cannot be set is a malfunction of the built-in microphone.

  On the other hand, when the setting of the built-in microphone is completed within T4 time (S206: Yes), a notification that the audio data can be output is transmitted to the image projection apparatus 110 (S207). Then, sound collection by the built-in microphone is started (S209), the sound data is compressed (S211), and the sound compression data is transmitted to the image projector 110 (S212).

  It is determined whether an end notification has been received (S213). Until the end notification is received, the processing of S209, S211 and S212 is executed. On the other hand, if there is an end notification (S213: Yes), the audio compressed data transmission is ended, the built-in microphone setting is restored (S214), and the network connection is ended (S215). Note that the processing may be ended by displaying an end button or the like on the information processing apparatus 130 side and selecting the end button.

  According to the image projection system 100 according to the present embodiment described above, the presenter enables the microphone of the information processing apparatus 130 specified as a speaker from among the participants, and collects the information from the microphone of the information processing apparatus 130 of the speaker. The sound that has been sounded is sent to the image projection apparatus 110, and the image projection apparatus 110 can output this sound from a built-in speaker.

  Therefore, when a conference, presentation, or the like using the image projection apparatus 110 is performed, the speech of the participant who listens to the speech of the presenter can be easily heard by the presenter and other participants. This eliminates the need for the presenter to re-examine the content of the speaker. Thereby, it can be set as an efficient image projection system.

  The above-described embodiment is a preferred embodiment of the present invention, but is not limited thereto, and various modifications can be made without departing from the gist of the present invention.

  In the above-described embodiment, the image projection apparatus is described by taking a DLP (Digital Light Processing) type projector as an example. However, the image projection apparatus is not limited to this, and is not limited to this, but is an LCD (Liquid Crystal Display) type, LCOS (Liquid crystal on silicon). ) Method or the like. Moreover, although the example which uses an arc lamp as a light source was demonstrated, it is not restricted to this, You may use a laser, LED, etc.

10 Main control unit 11 CPU
12 ROM
13 SDRAM
14 NVRAM
20 video input terminal unit 21 video / audio processing unit 22 audio output unit 25 operation control unit 26 remote control 30 optical control unit 31 lamp driving unit 32 lamp 33 optical unit 40 network control unit 100 image projection system 110 image projection apparatus (projector)
120 video supply device 130 information processing device 131 input unit 132 display unit 133 communication unit 134 CPU
135 RAM
136 Storage Unit 137 Sound Collection Unit 138 Audio Data Output Request Reception Unit 139 Audio Compression Data Transmission Unit 140 Network 141 LAN Cable 142 Wireless LAN
150 Cable 160 Screen 170 Projected image 171 PC selection screen 172 End button 173 Audio data reception screen 174 End button

JP 2006-138972 A

Claims (7)

An image projection system that projects a projection image on a projection surface and a plurality of information processing apparatuses connected via a network,
The image projector is
A recording unit that records identification information and user information of the plurality of information processing devices in association with each other;
A control unit that issues an audio data output request to an information processing device selected from the plurality of information processing devices, and outputs audio data received from the selected information processing device from an audio output unit; With
The information processing apparatus includes:
A sound collection unit for collecting sound;
An image projection system comprising: a control unit that, when receiving the output request, enables the sound collection unit and transmits audio data collected by the sound collection unit to the image projection device. . The information processing apparatus includes:
As the audio data, send audio compression data obtained by compressing the audio data,
The image projector is
The image projection system according to claim 1, wherein the compressed audio data is decompressed and output from the audio output unit. The image projector is
The image projection system according to claim 1 or 2, wherein a list of the identification information and the user information is displayed on the projection image so as to be selectable by a user.   The image projection system according to claim 1, wherein the identification information is a MAC address of a communication unit of the information processing apparatus main body or the information processing apparatus.   The image projection system according to any one of claims 1 to 4, wherein the user information includes at least one of a user's name, name, and identification ID. The image projector is
The image projection system according to claim 1, wherein the audio data is recorded in the recording unit. An image projection apparatus for projecting a projection image on a projection surface and the image projection apparatus in an image projection system in which a plurality of information processing apparatuses are connected via a network,
A recording unit that records identification information and user information of the plurality of information processing devices in association with each other;
A control unit that issues an audio data output request to an information processing device selected from the plurality of information processing devices, and outputs audio data received from the selected information processing device from an audio output unit; An image projection apparatus comprising: