JP6424927B2 - Processing control method and processing control system - Google Patents

Description

The present application relates to a process control method and a process control system .

  For example, there is known a method in which a mobile device such as a PDA (Personal Digital Assistants) or a cellular phone operates an external device connected via a network based on an instruction input on an operation screen (for example, a patent) Reference 1).

  However, according to the method of Patent Document 1 described above, even when it is desired to connect to a nearby device, since it is necessary to operate while looking at the operation screen, it has not been possible to connect immediately. In addition, for example, when connected to a device installed in a public place by a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark) (Wireless Fidelity) and operated, there was a problem in terms of security. .

  In one aspect, the present invention aims to execute processing according to a predetermined device in a predetermined place with a simple operation.

In one aspect, the process control method includes: a registration step of correlating a process to be performed on a user present in a predetermined range with identification information issued from the device and registering the process in a storage device; And the communication terminal acquires the identification information emitted by the device when the moving user approaches from the place where the device is installed to within the predetermined range, and identifying based on the identification information Transmission step in which the communication terminal transmits the identification information to the information processing apparatus, and identification step specifying the process registered in association with the identification information transmitted in the transmission step, If, have a, a processing control step of controlling execution of a process specified by the specifying step, said processing control step, the predetermined range Controlled to photographing function for photographing an inner is activated, the user present within the predetermined range is provided viewable images taken to the user.

  It is possible to execute processing according to a predetermined device in a predetermined place by a simple operation.

It is a figure which shows an example of schematic structure of the apparatus control system which concerns on 1st Embodiment. It is a figure which shows an example of the function structure which concerns on a communication terminal. It is a figure which shows an example of the function structure which concerns on a control server. It is a figure which shows an example of the hardware constitutions which concern on a communication terminal. It is a figure which shows an example of the hardware constitutions which concern on a control server. It is a figure which shows an example of the apparatus control sequence which concerns on 1st Embodiment. It is a figure for demonstrating the modification of 1st Embodiment. It is a figure which shows an example of schematic structure of the apparatus control system which concerns on 2nd Embodiment. It is a figure which shows an example of the apparatus control sequence which concerns on 2nd Embodiment. It is a figure which shows an example of the table which a control server hold | maintains.

  Hereinafter, the embodiment will be described in detail.

First Embodiment
<Device control system: schematic configuration>
FIG. 1 is a diagram showing an example of a schematic configuration of a device control system according to the first embodiment. As shown in FIG. 1, the device control system 1 is configured to have a communication terminal 10, a control server 20, and imaging devices 30-1 to 30-2. The communication terminal 10, the control server 20, and the imaging device 30 are connected by a communication network represented by, for example, the Internet, a wireless LAN, Bluetooth (registered trademark) or the like.

  In addition, although the example of FIG. 1 shows imaging devices 30-1 to 30-2 such as a camera, it is not limited to this and may be another device, and the number of devices is not limited to this. . The imaging devices 30-1 to 30-2 will be referred to as imaging devices 30 as appropriate.

  The communication terminal 10 is, for example, a portable terminal such as a smart phone or a tablet terminal such as a PDA. For example, the communication terminal 10 detects an operation such as “shaking” of the communication terminal 10 as an example of a predetermined operation by the user, and collects the device identification sound emitted by the imaging device 30 within a predetermined range at the detected timing. And transmits the collected device identification sound to the control server 20.

  Here, the device identification sound is, for example, a sound for identifying a device set to a different sound for each device. The device identification sound is, for example, a mosquito sound or a predetermined pattern sound formed by a frequency of a high frequency band (for example, 18 kHz or more) outside the audible band that does not become noise, but is not limited thereto.

  The control server 20 executes predetermined processing on the communication terminal 10 and the imaging device 30 according to the device identification sound acquired from the communication terminal 10. For example, when the control server 20 analyzes the device identification sound and specifies the imaging device 30 corresponding to the device identification sound, the control server 20 instructs the specified imaging device 30 to execute a preset process.

  The imaging device 30 generates a device identification sound in a predetermined range set in advance. The predetermined range may be a range in which a device identification sound output by a speaker or the like built in the imaging device 30 can reach, and as shown in FIG. 1, it is output from a speaker or the like externally connected to the imaging device 30 It may be within the reach of the device identification sound. Further, the imaging device 30 executes a predetermined process in accordance with an instruction from the control server 20.

  In the example of FIG. 1, the imaging device 30 is installed at a predetermined place such as a theme park, an amusement park, a shooting spot such as a sightseeing spot, and generates a device identification sound in a predetermined range which can be shot. . In addition, although it is preferable to generate each imaging device 30 in the range which other apparatus identification sound does not interfere, it is not limited to this.

  For example, when the communication terminal 10 detects an operation such as “shake” by the user at a place where the imaging device 30-1 is installed, the communication terminal 10 collects the device identification sound emitted from the imaging device 30-1, and collects the collected devices. The identification sound is transmitted to the control server 20 ((1) shown in FIG. 1). The communication terminal 10 transmits terminal identification information (for example, a terminal IP address) or the like for identifying the communication terminal 10 in addition to the device identification sound.

  The control server 20 analyzes the device identification sound acquired from the communication terminal 10, and determines that the device corresponding to the analyzed device identification sound is, for example, the imaging device 30-1, in advance with respect to the imaging device 30-1. As the set processing, for example, an instruction to perform photographing is given ((2) shown in FIG. 1). The imaging device 30-1 performs imaging at the installed position, and transmits the captured image to the control server 20 ((3) shown in FIG. 1). When the control server 20 acquires a photographed image from the imaging device 30-1, the control server 20 transmits the photographed image to the communication terminal 10 which has acquired the corresponding device identification sound ((4) shown in FIG. 1).

  As described above, the communication terminal 10 performs an operation such as “shake” in the vicinity of the device for which a predetermined process is desired to be performed, collects the device identification sound emitted by the device, and transmits it to the control server 20 Thus, the control server 20 can control the device to execute predetermined processing.

<Communication terminal 10: Functional configuration>
FIG. 2 is a diagram showing an example of a functional configuration related to the communication terminal. As shown in FIG. 2, the communication terminal 10 includes an input unit 11, an output unit 12, an operation detection unit 13, a sound collection unit 14, a storage unit 15, a position information reception unit 16, and a communication unit 17. , And control means 18.

  The input unit 11 receives, for example, input of start / end and setting of various instructions from the user. The output unit 12 outputs the content input by the input unit 11 or the content executed based on the input content, or displays an image on the operation screen. The input unit 11 and the output unit 12 described above may function with an input / output integrated configuration such as a touch panel, for example.

  The operation detection unit 13 detects a predetermined operation on the communication terminal 10, and determines, for example, whether there has been a "shake" operation by the user. The motion detection unit 13 can detect, for example, from the value obtained by the acceleration sensor 37, that there is a motion such as “shake”. The predetermined operation may be, for example, an operation of “turning the main body of the communication terminal 10”, or a predetermined operation (for example, swipe, double tap) performed by the user on the screen of the communication terminal 10 It is not limited to

  The sound collecting unit 14 collects, for example, the device identification sounds emitted from a device in a predetermined range, for example, when it is determined by the operation detection unit 13 that there is a “shake” operation or the like, for example. It is not limited. The sound collection unit 14 may collect the above-described device identification sound, for example, in response to a predetermined operation by the user (for example, “always mode” on the screen, selection of a sound collection button, and the like).

  The storage unit 15 stores, for example, the device identification sound collected by the sound collection unit 14, stores in advance terminal identification information or the like for identifying the communication terminal 10, or the position obtained by the position information reception unit 16. Store information

  The position information receiving unit 16 receives positioning information (position information) via, for example, a GPS (Global Positioning System), an IMES (Indoor MEssage System), or the like. Here, the position information receiving unit 16 may receive position information using, for example, Wi-Fi, ultrasonic waves, visible light communication, positioning technology using an autonomous navigation type, or the like, and is not limited thereto.

  The communication unit 17 transmits and receives, for example, data to and from the control server 20 via the communication network described above. The communication unit 17 transmits, for example, the device identification sound collected by the sound collection unit 14, the terminal identification information for identifying the communication terminal 10, the position information received by the position information reception unit 16, etc. , Receive an image or the like transmitted from the control server 20.

  The control unit 18 controls the entire configuration of the communication terminal 10. For example, the control unit 18 controls operation detection processing by the operation detection unit 13, collection processing of device identification sound by the sound collection unit 14, and the like.

<Control server 20: Functional configuration>
FIG. 3 is a diagram illustrating an example of a functional configuration related to the control server. As shown in FIG. 3, the control server 20 includes an input unit 21, an output unit 22, a sound analysis unit 23, a process execution unit 24, a storage unit 25, a communication unit 26, and a control unit 27. Configured as.

  The input unit 21 includes, for example, a pointing device, a touch panel, a hard key, and the like, and receives inputs such as start and end of various instructions from the user or the like. The output unit 22 outputs, for example, the content input by the input unit 21, the content executed based on the input content, data received via a communication network, and the like.

  The sound analysis unit 23 analyzes the device identification sound acquired from the communication terminal 10, and extracts device identification information and the like for identifying a device included in the analyzed device identification sound. The sound analysis means 23 is, for example, based on a frequency set in advance corresponding to a predetermined numerical value (for example, “1”, “2”, etc.), for example, a predetermined pattern set in advance corresponding to device identification information etc. For example, "1111" is extracted.

  The process execution unit 24 executes, for example, a process corresponding to the device identification sound obtained from the communication terminal 10. The process execution unit 24 determines an apparatus which executes a process set in advance corresponding to the apparatus identification sound, for example, by analyzing the apparatus identification sound. For example, when the position information is acquired from the communication terminal 10 together with the device identification sound, the processing execution means 24 determines the device to execute the preset processing based on the device identification sound and the position information. Also good.

  The processing execution unit 24 instructs, for example, the imaging device 30 corresponding to the device identification sound to shoot a predetermined range, and acquires a captured image from the imaging device 30 that instructed the capturing, the acquired captured image as a communication terminal Send to 10 The processing execution unit 24 stores, for each communication terminal 10, captured images obtained from the respective imaging devices 30 corresponding to a plurality of different device identification sounds, and transmits the stored captured images to each communication terminal 10. Also good.

  The storage unit 25 stores a determination table of processing content corresponding to the device identification sound, an information table acquired from the communication terminal 10, and the like. The communication unit 26 exchanges data with devices such as the communication terminal 10 and the imaging device 30.

  The control means 27 controls the entire configuration of the control server 20. For example, the control unit 27 controls sound analysis processing by the sound analysis unit 23 and processing by the processing execution unit 24.

<Communication terminal: hardware configuration>
FIG. 4 is a diagram illustrating an example of a hardware configuration related to the communication terminal. As shown in FIG. 4, the communication terminal 10 is configured to have a touch sensor 31, a touch panel display 32, a central processing unit (CPU) 33, and a read only memory (ROM) 34. Furthermore, the communication terminal 10 is configured to have a RAM (Random Access Memory) 35, a storage device 36, an acceleration sensor 37, a position information receiving device 38, a voice input device 39, and an interface device 40. .

  The touch sensor 31 detects an operation on the touch panel display 32, for example. The touch sensor 31 acquires parameters at, for example, a timing at which a touch on the touch panel display 32 is detected.

  The parameters to be acquired include, for example, touch events, coordinates (Vx, Vy) of positions where there is a touch on the touch panel display 32, the number of positions where there is a touch, variation amounts of position coordinates (ΔVx, ΔVy), The change amount per time (tVx, tVy) or the like. The parameters to be acquired are not limited to this.

  The touch panel display 32 displays various data on the screen, and displays an operation screen for acquiring predetermined input data by an operation from the user.

  The CPU 33 reads programs and data from the ROM 34 and the storage device 36 onto the RAM 35 and executes processing to realize control and installation functions of the entire communication terminal 10. The CPU 33 has, for example, various chipsets, and connects to other devices via the chipset.

  The ROM 34 is, for example, a nonvolatile semiconductor memory (storage device) capable of holding internal data even after the power is turned off, and stores various programs and data. The RAM 35 is a volatile semiconductor memory that temporarily stores programs and data.

  The storage device 36 is a storage that accumulates various data such as images and sounds. The storage device 36 is configured by a generally used storage medium such as, for example, a hard disk drive (HDD), a solid state drive (SSD), an optical disk, or a memory card.

  The acceleration sensor 37 detects a change in acceleration of the communication terminal 10. The acceleration sensor 37 always acquires parameters at predetermined time intervals, for example. For example, in the acceleration sensor 37, X value, Y value, Z value, X value, Y value, change rate per time of Z value in three axes of XYZ, ΔX, ΔY, ΔZ, and X value, Y The values of the time interval tX, tY, tZ etc. when the value and the Z value change are respectively acquired.

  The position information receiving apparatus 38 has an antenna for receiving positioning signals such as GPS and IMES, for example, and receives position information included in the positioning signals.

  The voice input device 39 includes, for example, a microphone, and collects, for example, device identification sounds from the imaging device 30 or the like, and collects voices of users.

  The interface device 40 is an interface for communicating with other devices connected via, for example, a wireless LAN.

<Control server 20: hardware configuration>
FIG. 5 is a diagram illustrating an example of a hardware configuration related to the control server. As shown in FIG. 5, the control server 20 is configured to have an input device 41, a display device 42, an HDD 43, a ROM 44, a RAM 45, a CPU 46, an interface device 47, and a drive device 48. Each is connected to each other by a bus B.

  The input device 41 includes, for example, a keyboard and a mouse, and is used to input each operation signal. The display device 42 is configured by, for example, a display or the like, and displays the processing result.

  The HDD 43 is a non-volatile storage device storing programs and various data. An information processing system (for example, OS (Operating System) which is basic software such as "Windous (registered trademark)") and an application for providing various functions on the system are included in the stored programs and data. The HDD 43 manages stored programs and data by a predetermined file system and a DB (Data Base).

  The ROM 44 is a non-volatile semiconductor memory (storage device) capable of holding internal data even when the power is turned off. The ROM 44 stores programs and data such as a BIOS (Basic Input / Output System), information processing system settings, and network settings which are executed when the control server 20 is started.

  The RAM 45 is a volatile semiconductor memory that temporarily stores programs and data. The CPU 46 reads a program or data from the storage device ("HDD 43" or "ROM 44") onto the RAM 45 and executes processing to realize control and installation functions of the entire control server 20.

  The interface device 47 is an interface for connecting to a device to perform data communication. The drive device 48 is an interface with the removable recording medium 48A. The drive device 48 reads and writes the recording medium 48A.

  Examples of the recording medium 48A include a floppy disk, a CD (Compact Disk), a DVD (Digital Versatile Disk), an SD memory card (SD Memory card), a USB (Universal Serial Bus memory), and the like.

  The hardware configuration described above enables the control server 20 to execute various processes. The control server 20 may not have the input device 41 and the display device 42, for example.

First Embodiment Device Control Sequence
FIG. 6 is a diagram showing an example of the device control sequence according to the first embodiment. Note that FIG. 6 will be described using one imaging device 30 for convenience of description. As shown in FIG. 6, the imaging device 30 installed at a predetermined imaging spot generates, for example, an apparatus identification sound in a range where imaging is possible (S10).

  When the user holding the communication terminal 10 wants to take a picture at a predetermined photographing spot, the user shakes, for example, the main body of the communication terminal 10 while facing the imaging device 30. When the communication terminal 10 detects the "shake" operation by the operation detection unit 13 (S11), the sound collection unit 14 collects device identification sounds generated from the imaging device 30 (S12).

  Here, by swinging the communication terminal 10 toward the desired imaging device 30, the user can specify which device he / she wants to use with an intuitive operation. Note that the user may not shake the communication terminal 10 toward the imaging device 30 as long as the device identification sound can be collected. In addition, a mark such as a signboard in consideration of the imageable range of the imaging device 30 is provided in a predetermined imaging spot so that the user serving as the subject is photographed at an appropriate position, and the user operates the communication terminal 10 at the mark location. You may shake it.

  The communication terminal 10 transmits the collected device identification sound to the control server 20 by the communication means 17 together with the terminal identification information (for example, the terminal IP address) of the communication terminal 10 (S13). In the process of S13, the communication terminal 10 transmits the position information received by the position information receiving means 16 together with the device identification sound to the control server 20 in order to specify the device more accurately in the control server 20. Also good.

  The control server 20 analyzes the device identification sound acquired from the communication terminal 10 by the sound analysis unit 23 (S14), and determines that the device corresponding to the device identification sound is the imaging device 30 by the process execution unit 24 (S14) S15). Further, the control server 20 determines, by the processing execution means 24, the processing content set in advance corresponding to the device identification sound (S16).

  Next, when it is determined that the processing content set in advance instructs the imaging device 30 to perform imaging, for example, the control server 20 instructs the imaging device 30 to perform imaging in a predetermined range (S17). The imaging device 30 performs imaging based on an instruction from the control server 20 (S18).

  Note that, in the process of S18, the imaging device 30 may notify the user that imaging is performed from a speaker or the like before imaging. For example, if the imaging device 30 has a timer function, when the control server 20 instructs the imaging device 30 to take a picture, for example, after 5 seconds, the imaging device 30 receives an instruction of the control server 20 and then 5 It is possible to shoot after a second.

  Here, for example, the speaker of the imaging device 30 holds audio data for performing countdown such as 5 seconds in advance, the control server 20 instructs the imaging device 30 to perform photographing using a timer function, and the speaker of the imaging device 30 It is good to give an audio output instruction. Thereby, the speaker or the like of the imaging device 30 reproduces the audio data for counting down 5 seconds or the like according to the instruction from the control server 20, and the imaging device 30 can perform imaging in accordance with the audio data. Become.

  In addition, the control server 20 may hold the above-described audio data and transmit the audio data to the speaker of the imaging device 30 or the like, transmit the audio data to the communication terminal 10, and transmit the audio data to the communication terminal 10. May be played back to notify that shooting is to be performed. In addition, the control server 20 acquires the time when the user detects the "shake" operation, sets the timer based on that time, and instructs the imaging device 30 to take a picture after a predetermined time (for example, 5 seconds). You may.

  Further, in the process of S18, the imaging device 30 determines the direction of the face whether or not the person's face is included in the shooting range (field angle), and determines that the face is facing forward. When it is done, you may shoot. Note that whether or not the face is facing forward can be determined based on, for example, feature amounts of eyes, a nose, a mouth and the like, but is not limited thereto. The imaging device 30 may also shoot in the flash mode in accordance with the surrounding environment such as cloudy sky or night. Furthermore, shooting in the imaging device 30 is not limited to a still image, and may be a moving image.

  The imaging device 30 transmits the captured image to the control server 20 (S19). At the time of image transmission, image compression may be performed by a predetermined compression method. When acquiring the image from the imaging device 30, the control server 20 transmits the acquired image based on the terminal identification information (for example, the terminal IP address) acquired from the communication terminal 10 (S20).

  As described above, when the communication terminal 10 performs a “shake” operation or the like near the imaging device 30 that wants to take a picture, the control server 20 sends an imaging device 30 corresponding to the device identification sound collected by the communication terminal 10. It is possible to execute shooting on the other hand.

Modification of First Embodiment
FIG. 7 is a view for explaining a modification of the first embodiment. As shown in FIG. 7, it is assumed that imaging devices 30-1 to 30-2 are installed at predetermined imaging spots in, for example, a theme park, an amusement park, a sightseeing spot or the like. The number of imaging devices 30 is not limited to this.

  When the user holding the communication terminal 10 shakes the communication terminal 10 in advance and visits the shooting spot to select the “always mode”, the sound collection unit 14 always collects the device identification sound. Further, information indicating that the “always mode” is selected from the communication terminal 10 and the terminal identification information of the communication terminal 10 are transmitted to the control server 20.

  When the user visits a predetermined imaging spot, the communication terminal 10 collects device identification sounds from the imaging device 30 installed at the imaging spots, and the collected device identification sounds are combined with the terminal identification information of the communication terminal 10. , Sends to the control server 20.

  In the example of FIG. 7, it is assumed that the user visits points A to D in order and visits a shooting spot (point A) of the imaging device 30-1 and a shooting spot (point C) of the imaging device 30-2. When the user comes to the point A, the communication terminal 10 can collect, using the sound collection unit 14, the device identification sound emitted by the imaging device 30-1 in a predetermined range.

  When the device identification sound of the imaging device 30-1 is collected, the communication terminal 10 transmits the collected device identification sound and the terminal identification information of the communication terminal 10 to the control server 20 ((1) shown in FIG. 7). The control server 20 instructs the imaging device 30-1 to perform imaging ((2) shown in FIG. 7). The imaging device 30-1 captures an image of the user according to an instruction from the control server 20, and transmits the captured image to the control server 20 ((3) in FIG. 7).

  In addition, when the user moves to the imaging spot (point C) of the imaging device 30-2, the communication terminal 10 collects the device identification sound emitted by the imaging device 30-2 in a predetermined range by the sound collection unit 14 It is possible.

  After collecting the device identification sounds of the imaging device 30-2, the communication terminal 10 transmits the collected device identification sounds and the terminal identification information of the communication terminal 10 to the control server 20 ((4) shown in FIG. 7). The control server 20 instructs the imaging device 30-2 to perform imaging ((5) shown in FIG. 7). The imaging device 30-2 shoots the user according to the instruction of the control server 20, and transmits the shot image to the control server 20 ((6) shown in FIG. 7).

  Furthermore, after the user moves to the point D, the communication terminal 10 requests the control server 20 to acquire an image captured by the imaging device 30-1 to 30-2 ((7) shown in FIG. 7), the control server It is possible to obtain a corresponding image from 20 ((8) shown in FIG. 7).

  As described above, the communication terminal 10 selects the “always mode” in advance, and thereby, while moving the imaging spot, the images captured by the plurality of imaging devices 30 installed in the imaging spot are displayed. , And can be acquired from the control server 20.

  In the first embodiment described above, an example in which shooting is performed using the timer setting (function) is shown, but it may be desirable not to use the timer setting in the “always mode” of this modification. In the first embodiment, the user performs an operation such as "shake" on the communication terminal 10 in a stationary state at the imaging spot, but in the "always mode" of the modification, the imaging is performed when the user is moving It may be That is, when the timer setting is used, the user of the communication terminal 10 that has acquired the device identification sound may be out of the range in which it can be photographed as a subject.

  Therefore, control server 20 manages the terminal identification information of communication terminal 10 operating in the “always mode” in a predetermined storage area, and receives the device identification sound and the terminal identification information from communication terminal 10, Based on the received terminal identification information, it is determined whether it is operating in the "always mode". In the case of the communication terminal 10 operating in the “always mode”, the control server 20 issues a shooting instruction without timer setting, and in the case of the communication terminal 10 not operating in the “always mode”, the timer setting It is good to give some shooting instructions.

  The control server 20 manages the settings relating to the above-mentioned shooting instruction in a plurality of modes, identifies the mode in which the communication terminal 10 is operating from the terminal identification information of the communication terminal 10, and responds to the mode. You may give a shooting instruction.

  The communication terminal 10 may register the face image of the user in the control server 20 in advance. In this case, when instructing the imaging device 30 to take a picture, the control server 20 also transmits the face image of the user together and instructs the imaging device 30 to take a picture at the timing when the user's face is detected.

  The communication terminal 10 may sequentially acquire photographed images photographed by the respective imaging devices 30-1 to 30-2 from the control server 20, and browsed the photographed images held by the control server 20 for each communication terminal 10. You may collect it later. For example, the communication terminal 10 requests the control server 20 to create an album of a selected shot image among the shot images browsed, and the control server 20 requests the predetermined shop to create an album.

  In this case, the communication terminal 10 may receive, for example, billing information for album creation, a scheduled creation time, a product number, and the like from the shop via the control server 20, and the user may receive the album at the shop. .

  Note that a predetermined server (for example, for Photoshop (registered trademark)) is installed, and for example, in the control server 20, the imaging device 30 is combined with the terminal identification information of the communication terminal 10 in the first embodiment or the modification. It is also possible to set processing content for transmitting the photographed image to the server for Photoshop. The server for Photoshop stores and manages the photographed image received from the control server 20 in association with the terminal identification information of the communication terminal 10.

  The communication terminal 10 accesses the server for Photoshop when the installed application for Photoshop is activated by user operation, and transmits the terminal identification information of the communication terminal 10 to enable browsing of the corresponding photographed image. .

  When the server for photo shop receives a request for creating an album of the selected photographed image among the photographed images browsed by the user from the communication terminal 10, the server performs the charging process described above. Thereafter, when the user goes to the shop to receive the album, the application can be conveniently used.

Second Embodiment
<Device control system: schematic configuration>
FIG. 8 is a diagram showing an example of a schematic configuration of the device control system according to the second embodiment. The second embodiment shown in FIG. 8 is different from the first embodiment shown in FIG. 1 in the device that emits the device identification sound, and in the processing that the control server 20 executes in response to the device identification sound. Hereinafter, differences will be mainly described.

  As shown in FIG. 8, the device control system 2 is configured to have the communication terminal 10, the control server 20, and the signage 50. The communication terminal 10, the control server 20, and the signage 50 are connected by a communication network represented by, for example, the Internet, a wireless LAN, Bluetooh (registered trademark) or the like.

  The signage 50 is, for example, an electronic signboard or an advertising medium whose display content can be switched by digital communication, and is, for example, a content output device that outputs content such as a moving image. In the example of FIG. 8, the signage 50 is installed, for example, at a trade show, and outputs contents such as CM and a campaign advertisement, for example, and presents the contents to surrounding users.

  The sound output to a predetermined range corresponding to the content by the signage 50 includes, for example, a device identification sound for identifying the signage 50. The content output by the signage 50 may be managed by the control server 20, and the content may be transmitted from the control server 20 to the signage 50 and reproduced.

  When the communication terminal 10 detects an operation such as “shake” of the user at the installation place of the signage 50, the communication terminal 10 collects the device identification sound included in the content output by the signage 50. Also, the communication terminal 10 transmits the collected device identification sound and the terminal identification information of the communication terminal 10 to the control server 20 ((1) shown in FIG. 8).

  When the control server 20 analyzes the device identification sound acquired from the communication terminal 10 and determines that the device corresponding to the device identification sound is the signage 50, the control server 20 relates to the content being output as the processing corresponding to the signage 50. Information and the like are transmitted to the communication terminal 10 ((2) shown in FIG. 8).

  Here, the information related to the content is, for example, additional information such as a coupon, a questionnaire, store information displayed as the content, but is not limited to this.

  The signage 50 can output contents by designating a date and time in advance. For example, the control server 20 manages, in advance, the content output by the signage 50 in association with the content output date and time (for example, a period or a time zone).

  The control server 20 specifies the signage 50 from the device identification sound when the date and time information of acquiring the device identification sound is transmitted from the communication terminal 10 together with the device identification sound. In addition, the control server 20 may determine the output content based on the information of the content output date and time of the specified signage 50 and the date and time information acquired from the communication terminal 10.

  In addition, although the signage 50 outputs the content on the screen 51 as shown in FIG. 8, for example, the display content on the screen 51 can be changed. For example, the control server 20 prepares a file (display data) for a questionnaire response to be transmitted to the communication terminal 10 as information related to the content output by the signage 50, and the file is transmitted to the communication terminal 10. Send it and display the questionnaire response screen. The user of the communication terminal 10 answers, for example, the displayed questionnaire by a touch operation or the like, and transmits the answer result to the control server 20 ((3) shown in FIG. 8).

  When the control server 20 acquires the answer results of the questionnaire from the communication terminal 10, the control server 20 may totalize the answer results and may instruct the screen 51 of the signage 50 to output or update the total contents ((see FIG. 4)). At this time, for example, the control server 20 divides the screen 51 of the signage 50 into an advertisement screen and a tabulation screen, outputs content to the advertisement screen, and outputs a tabulation result of questionnaires related to the content to the tabulation screen. To the signage 50.

  When the control server 20 is configured by a plurality of projectors including a projector that projects the advertisement screen and a projector that projects the aggregation screen, the control server 20 is a display screen in which the aggregation result is updated to the projector that projects the aggregation screen. Data may be transmitted and projected. At this time, it is assumed that the control server 20 holds the transmission destination (IP address or the like) of the projector that issues the projection instruction.

  In addition, since the answer of the questionnaire is optional by the user, the control server 20 transmits, for example, a coupon according to the answer result to the communication terminal 10 for which the answer of the questionnaire is obtained, thereby improving the user's willingness to answer You may build a mechanism that For example, in the case where the content of the questionnaire is “which product A or product B do you like?” And the like, when the answer that the product A is selected is obtained from the communication terminal 10, the control server 20 receives the discount coupon of the product A (1) display data) may be transmitted to provide information suited to the taste of the user.

  At this time, the control server 20 sends a file to the communication terminal 10 (coupon screen, in addition to file transmission (for example, questionnaire screen) to the communication terminal 10 as processing content (workflow), answer aggregation, and projection instruction to signage 50. ) Transmission is added. In the control server 20, a file (coupon screen) corresponding to the answer result may be registered in advance, and a file corresponding to the answer result acquired from the communication terminal 10 may be transmitted to the communication terminal 10 and displayed.

  As described above, the control server 20 can control the signage 50 to allow the communication terminal 10 and the signage 50 to cooperate in real time.

Second Embodiment Device Control Sequence
FIG. 9 is a diagram showing an example of a control sequence according to the second embodiment. Steps S21 to S24 in the control sequence shown in FIG. 9 are the same as steps S11 to S14 in the control sequence shown in FIG.

  In the process of S23 shown in FIG. 9, when the communication terminal 10 transmits the collected device identification sound together with the terminal identification information of the communication terminal 10 to the control server 20, the date and time information at which the device identification sound was collected is also It is good to send together.

  When the control server 20 determines that the corresponding device is the signage 50 by the device identification sound acquired from the communication terminal 10 by the processing execution means 24 (S25), the processing content set in advance corresponding to the device identification sound Is determined (S26).

  Here, for example, “a file (for example, a questionnaire) related to the content output from the signage 50 is transmitted to the communication terminal 10 to obtain an answer from the communication terminal 10 as the processing content set in advance. In this case, the control server 20 determines a file to be transmitted to the communication terminal 10 (S27). The control server 20 may determine the file to be transmitted based on the date and time information acquired from the communication terminal 10.

  Next, when the control server 20 transmits a file to the communication terminal 10 (S28), and the communication terminal 10 transmits an answer to the file (S29), the control server 20 performs aggregation based on the answer (S30). . Next, when the control server 20 instructs the signage 50 to output contents (S31), the signage 50 outputs the screen on the basis of the instruction (S32).

  As described above, in the second embodiment, when the communication terminal 10 performs the “shake” operation near the signage 50, the communication terminal 10 can acquire the information related to the content from the control server 20. Moreover, in the second embodiment, the communication terminal 10 and the signage 50 can cooperate with each other to control the output content of the signage 50 by the control server 20.

<Example of information held by control server>
FIG. 10 is a diagram showing an example of information held by the control server. In addition, FIG. 10 is information used when comprising the system which included these in embodiment or modification mentioned above.

  FIG. 10A shows an example of the determination table of the processing content corresponding to the device identification sound. FIG. 10 (B) shows the information acquired from the communication terminal 10 in the form of a table.

  The table shown in FIG. 10A has items such as “device”, “sound information”, “position condition”, “date and time condition”, “target data”, “processing content”, etc. Is not limited.

  For example, “device” indicates a device controlled by the control server 20 to execute a predetermined process. The “sound information” indicates device identification information (for example, “sound 1” → “1111”) for identifying the “device”. The “position condition” indicates position information (for example, “area 1” and the like) where the “device” is installed.

  The “date and time condition” and the “target data” are information used when the control server 20 executes the “process content”. The control server 20 specifies “device”, “target data” and “process content” using the “sound information”, “position condition” and “date and time condition” items, but “position condition” and “position condition” The “date and time condition” is not essential, and it may be registered in the determination table when it is desired to use these conditions.

  Further, in the “process content”, for example, the “apparatus” which is the target of the process, the content of the process to be executed to the communication terminal 10, the specific device set in advance, and the like are defined. The example of FIG. 10A shows an example in which the order of processing to be executed is set by, for example, a workflow. Also, for each process, the operation content of the process, the device to which the process is to be performed (that is, the “device”, the communication terminal 10, the specific device set in advance, etc.) Various parameters such as (timer ON / OFF etc.) are defined as necessary.

  The table shown in FIG. 10B has items such as “terminal identification information”, “sound information”, “position information”, “date and time information”, and “use mode”, for example, but is not limited thereto. .

  For example, “terminal identification information” is information (terminal IP address or the like) for communicating with the communication terminal 10. The “sound information” is device identification information extracted from the device identification sound acquired by the communication terminal 10. “Position information” is position information received by the communication terminal 10. “Date and time information” is date and time information when the device identification sound is collected.

  The “use mode” includes, for example, “shake mode” and “always mode”, and is used to set the processing content as described above. In the "shake mode", the process ends when the "process content" is executed. In the "always mode", for example, the "processing content" is continuously executed in the constantly activated state until the "shake mode" is detected again.

  The control server 20 determines the corresponding processing content from the table shown in FIG. 10 (A) based on the information shown in FIG. 10 (B), and executes the processing content. In the case of constructing a comprehensive system, the items shown in FIG. 10 (B) are different in the items to be used according to the condition determination, so that the communication terminal 10 controls the information used for the condition determination It is good to implement in the application installed in the communication terminal 10 so that it may transmit to 20. FIG.

  Here, contents executed by the control server 20 will be described using the information shown in FIG. 10 described above. For example, when the control server 20 analyzes the device identification sound acquired from the communication terminal 10 and determines that the extracted device identification information is "sound 1", the control server 20 determines from the table shown in FIG. It is determined that the "device" corresponding to 1 "is the" imaging device 30-1. " Further, the control server 20 determines that the “processing content” is “shooting → data storage → transmission”.

  For example, when the position information is acquired from the communication terminal 10, the control server 20 determines whether the acquired position information corresponds to the “position condition” of the determined “imaging device 30-1”. For example, when the position information acquired from the communication terminal 10 is “area 1”, it corresponds to “area 1” which is the “position condition” of “imaging device 30-1”, so the device identification sound is It is possible to determine that the corresponding device is the “imaging device 30-1”. As described above, it is possible to more accurately determine the device corresponding to the device identification sound.

  Further, when the control server 20 determines that the device identification information extracted from the device identification sound is “sound 3”, it determines that the “device” corresponding to “sound 3” is “signage 50-1”. To execute "process content", it is determined whether "target data" is "file 1" or "file 2".

  Here, when the date and time information acquired from the communication terminal 10 is “3/3 10:00”, the control server 20 determines that “target data” is “file 1”, and “file 1”. Are controlled to be transmitted to the communication terminal 10.

  As described above, the control server 20 can execute processing corresponding to the device that has generated the device identification sound, based on the device identification sound and the like acquired from the communication terminal 10.

<Other Embodiments>
In the device control systems 1 and 2 shown in FIGS. 1 to 10 described above, the process corresponding to the device identification sound acquired by the communication terminal 10 is executed by the control server 20, but the invention is not limited thereto.

  For example, when the communication terminal 10 detects the above-mentioned “shake” operation by the user among the applications displayed on the operation screen, and the application for executing the predetermined process is activated, the process proceeds as follows. Also good.

  For example, in the examples of FIG. 1 and FIG. 8 described above, the communication terminal 10 causes the imaging device 30 and signage 50 to execute processing via the control server 20, but directly connects these devices to execute processing. Also good.

  Therefore, when the above-described application is activated, for example, the communication terminal 10 causes the user to select “directly communicate”, “do not directly communicate”, or the like on the operation screen. When “do not directly communicate” is selected, the communication terminal 10 selects and executes the processing via the control server 20 described above.

  When “directly communicate” is selected, the communication terminal 10 directly communicates based on a different sound for each device emitted from the device (for example, a sound including connection information for connecting to the device). Execute the process on the linked device. As a result, in the case of not only the above-described device but, for example, an MFP (Multifunction Peripheral) or a projector, it is possible to execute processing for transmitting and outputting data from the communication terminal 10.

  According to the embodiment described above, it is possible to execute processing according to a predetermined device in a predetermined place with a simple operation. In the device control system described above, a plurality of control servers 20 may be configured, and each server device connected via a network may perform processing in a distributed manner.

  For example, the communication terminal 10, the imaging device 30, the signage 50, or a server device on an external system by a control system in which one or more server devices are connected via a network and controlled to perform processing in cooperation with one another. Processing may be performed. The control server 20 is not limited to the server device and may be realized by a PC (Personal Computer) or the like, and the control system described above may be configured by one or more information processing devices.

  Although the preferred embodiments of the disclosed technology have been described in detail, the present invention is not limited to the specific embodiments according to the disclosed technology, but within the scope of the disclosed technology described in the claims. Various modifications and changes are possible.

1, 2 Equipment control system 10 Communication terminal 11, 21 Input means 12, 22 Output means 13 Operation detection means 14 Sound collection means 15 Storage means 16 Position information reception means 17 Communication means 18, 27 Control means 20 Control server 23 Sound analysis means 24 processing execution means 25 storage means 26 communication means 30 imaging device 31 touch sensor 32 touch panel display 33, 46 CPU
34, 44 ROM
35,45 RAM
36 storage device 37 acceleration sensor 38 position information receiving device 39 voice input device 40, 47 interface device 41 input device 42 display device 43 HDD
48 drive unit 48A recording medium 50 signage

Unexamined-Japanese-Patent No. 2006-163794

Claims (10)

A registration step of correlating a process for executing a user existing within a predetermined range with identification information issued from the device and registering the associated information in the storage device;
An acquisition step in which the communication terminal acquires the identification information emitted by the device when the user moving in possession of the communication terminal approaches from the location where the device is installed to within the predetermined range;
A transmitting step in which the communication terminal transmits the identification information to the information processing apparatus in order to execute a process specified based on the identification information;
An identifying step of identifying a process registered in association with the identification information transmitted by the transmitting step;
A process control step for controlling the execution of the process specified by the specific step;
I have a,
The process control step controls so as to activate an imaging function for imaging the predetermined range, and process control for providing the user the image captured by the user within the predetermined range so as to be viewable to the user Method. The processing control method in a system in which a plurality of the devices emitting the identification information are installed in a facility and provides a service in cooperation with the communication terminal possessed by the user moving in the facility,
The process control method according to claim 1, wherein the transmission step transmits the identification information capable of identifying which one of the plurality of devices is obtained from the communication terminal to the information processing device. In the acquisition step, a user who moves and holds the communication terminal keeps the function installed in the communication terminal held by the user in order to obtain the identification information. The process control method according to claim 1 or 2 , wherein the identification information is acquired by approaching from the device to the predetermined range. The process control method according to any one of claims 1 to 3 , wherein the process control step includes a first providing step of providing information to the user via the communication terminal possessed by the user. . Presenting the content to the user via a screen;
Receiving a response from the user via the communication terminal for which information has been provided by the first providing step;
Displaying on the screen a result obtained from the response returned from the one or more users by the receiving step;
A second providing step of providing further information to the communication terminal that has sent the response;
The process control method according to claim 4 , comprising: A processing control system that includes a communication terminal possessed by a user, an apparatus that emits identification information, and an information processing apparatus communicably connected to the communication terminal, and controls processing according to the movement of the user,
A registration unit that associates the process of executing for the user existing within a predetermined range with the identification information issued from the device and registers the associated information in a storage device;
Acquisition means for acquiring the identification information emitted by the communication terminal from the device by the user moving in possession of the communication terminal approaching from the location where the device is installed to within the predetermined range; ,
Transmitting means for causing the communication terminal to transmit the identification information to the information processing apparatus in order to execute processing specified based on the identification information;
Specifying means for specifying the process registered in association with the identification information transmitted by the transmission means;
Processing control means for controlling execution of the process specified by the specifying means;
I have a,
The process control means performs control to activate an imaging function for imaging the predetermined range, and process control for providing the user with an image captured by the user within the predetermined range so as to be viewable to the user system. The processing control system in a system in which a plurality of the devices emitting the identification information are installed in a facility and provides a service in cooperation with the communication terminal owned by the user moving in the facility,
7. The process control system according to claim 6 , wherein the transmission means transmits the identification information capable of identifying which one of the plurality of devices is obtained from the communication terminal to the information processing device. The acquisition unit continuously activates a function installed in the communication terminal possessed by the user in order to acquire the identification information, whereby a user who moves and holds the communication terminal can The processing control system according to claim 6 or 7 , wherein the identification information is acquired by approaching from the device to the predetermined range. The process control system according to any one of claims 6 to 8 , wherein the process control means has first providing means for providing information to the user via the communication terminal possessed by the user. . Presentation means for presenting content to the user via a screen;
Receiving means for receiving a response from the user via the communication terminal provided with information by the first providing means;
Display means for displaying on the screen the result obtained from the response returned from the one or more users by the receiving means;
Second providing means for providing further information to the communication terminal that has sent the response;
The process control system according to claim 9 , comprising:

Images