JP2022102847A - Information processor, information processing method, and information processing program - Google Patents

Abstract

To efficiently provide information to which a positional relationship among devices under an actual environment is reflected as accurately as possible.SOLUTION: An information processor includes a display section and a proposal section. The display section displays a user interface on which a plurality of virtual objects corresponding to a plurality of respective devices is arranged according to an arrangement form of the plurality of devices under an actual environment. The proposal section derives an object to be previously positioned on the user interface for functioning as a reference of arrangement estimation processing according to the arrangement form from the plurality of virtual objects arranged on the user interface before executing arrangement estimation processing for associating the virtual object with identification information corresponding to the virtual object, and proposes to an operator.SELECTED DRAWING: Figure 12

Description

The present disclosure relates to information processing devices, information processing methods and information processing programs.

Radio waves (hereinafter, appropriately referred to as "radio signals") are attenuated in the process of propagating in space. Thereby, for example, a radio signal transmitted from another radio is received, and the distance between the radios is estimated from the strength of the received radio signal (hereinafter referred to as "reception strength" or "reception level"). Is possible. A technique for finding the distance between a mobile station and a base station from the reception level of radio waves from a mobile station has also been proposed.

Further, in studios, theaters and the like, lighting systems for performing lighting effects by a plurality of lighting devices have been introduced. In this lighting system, a lighting effect is executed by remotely controlling the illuminance of each lighting device, the color of the light to be illuminated, and the like by using the control address set on each lighting device side.

In such a lighting system, preparation work is performed to adjust the correspondence such as the types and arrangements of a plurality of lighting devices connected to a plurality of ports according to changes in lighting effects and the like. The operator who performs the preparation work may make various settings for each of the lighting devices by operating the icons corresponding to the individual lighting devices arranged on the user interface displayed on the information processing device.

Further, as described above, when the lighting device is set via the icon arranged on the user interface, the operator is individually assigned to each of the lighting devices in advance with respect to the above-mentioned icon. It is necessary to link the identification information. Therefore, for example, the operator collects the identification information individually assigned to each of the lighting devices, and then sequentially sends a lighting instruction to each of the collected identification information to the lighting space ( Visually check the position of the lighting device that is lit in the actual environment). Then, the operator confirms the correspondence between the position of the lit lighting device and the icon arranged on the user interface, and manually associates the above-mentioned icon with the above-mentioned identification information one by one.

In the above-mentioned linking work, the work load of the operator increases as the number of installed lighting devices increases. Therefore, in order to reduce the workload of the operator in the above-mentioned linking work, the relative positional relationship between the lighting devices was estimated and estimated by using the conventional technique of obtaining the distance from the strength of the radio signal. It is also being considered to improve the efficiency of the above-mentioned linking work by using the relative positional relationship.

Japanese Unexamined Patent Publication No. 11-178042

However, when arranging the above-mentioned icons on the user interface based on the relative positional relationship between the lighting devices, it is very difficult to realize the arrangement that correctly reflects the positional relationship of the lighting devices in the actual environment. Difficult to. It should be noted that this problem can also occur in cameras, radars, and various sensors that are expected to be arranged in a plurality of spaces.

Therefore, in the present disclosure, we propose an information processing device, an information processing method, and an information processing program that efficiently provide information that reflects the positional relationship of the device in an actual environment as accurately as possible.

The information processing apparatus according to an example of the embodiment includes a display unit and a proposal unit. The display unit displays a user interface in which a plurality of virtual objects corresponding to each of the plurality of devices are arranged according to the arrangement form of the devices in a real environment. The proposal unit performs placement estimation processing from among a plurality of virtual objects placed on the user interface before executing placement estimation processing that associates the virtual object with the identification information corresponding to the virtual object. Objects to be positioned in advance on the user interface are derived according to the arrangement form in order to function as a reference, and are proposed to the operator.

FIG. 1 is a diagram showing an example of a processing result of the arrangement estimation process. FIG. 2 is a diagram showing an example of a processing result of an arrangement estimation process using an anchor. FIG. 3 is a diagram showing an outline of an information processing system according to an embodiment. FIG. 4 is a plan view of the arrangement of the plurality of lighting devices shown in FIG. 3 from a bird's-eye view. FIG. 5 is a diagram showing an image display example of the user interface according to the embodiment. FIG. 6 is a diagram showing an image display example of the user interface according to the embodiment. FIG. 7 is a diagram showing an image display example of the user interface according to the embodiment. FIG. 8 is a diagram showing an image display example of the user interface according to the embodiment. FIG. 9 is a diagram showing an image display example of the user interface according to the embodiment. FIG. 10 is a diagram showing a configuration example of an information processing system according to an embodiment. FIG. 11 is a diagram showing a configuration example of the lighting device according to the embodiment. FIG. 12 is a block diagram showing a configuration example of the information processing apparatus according to the embodiment. FIG. 13 is a flowchart showing an example of the processing procedure of the information processing apparatus according to the embodiment.

The information processing apparatus 20 according to the embodiments and modifications described below includes a display unit 23 and a proposal unit 25c. The display unit 23 displays a user interface in which a plurality of virtual objects corresponding to each of the plurality of devices are arranged according to the arrangement form of the plurality of devices in a real environment. The proposal unit 25c estimates the placement from a plurality of virtual objects placed in the user interface before executing the placement estimation process for associating the virtual object with the identification information corresponding to the virtual object. Objects to be positioned in advance on the user interface to function as a processing reference are derived according to the arrangement form and proposed to the operator.

Further, in the embodiments and modifications described below, the proposal unit 25c proposes an object to be positioned next according to the arrangement position of the positioned object.

Further, in the embodiments and modifications described below, the proposal unit 25c selects from a plurality of virtual objects arranged in the user interface as a result of the arrangement estimation process when the arrangement estimation process is executed again. Suggest an object to be positioned.

Further, in the embodiments and modifications described below, the plurality of devices are lighting devices.

Further, in the information processing method according to the embodiment and the modification described below, the information processing apparatus 20 executes the display step and the proposed step. The display process displays a user interface in which a plurality of virtual objects corresponding to each of the plurality of devices are arranged according to the arrangement form of the plurality of devices in a real environment. In the proposal process, the placement estimation process is performed from among a plurality of virtual objects placed in the user interface before the placement estimation process for associating the virtual object and the identification information corresponding to the virtual object is executed. Objects to be positioned in advance on the user interface are derived according to the arrangement form in order to function as a reference, and are proposed to the operator.

Further, in the information processing program according to the embodiment and the modification described below, the information processing apparatus 20 is made to execute the display procedure and the proposed procedure. The display procedure displays a user interface in which a plurality of virtual objects corresponding to each of the plurality of devices are arranged according to the arrangement form of the plurality of devices in a real environment. The proposed procedure is a placement estimation process from a plurality of virtual objects placed in the user interface before executing the placement estimation process that associates the virtual object with the identification information corresponding to the virtual object. Objects to be positioned in advance on the user interface are derived according to the arrangement form in order to function as a reference, and are proposed to the operator.

<< Embodiment >>
<Introduction>
Hereinafter, a problem that may occur in the arrangement estimation process of arranging the icon corresponding to each illuminating device on the user interface based on the relative positional relationship between the illuminating devices will be described. The arrangement estimation process corresponds to a process of associating an icon arranged on the user interface with the identification information of each lighting device corresponding to the icon. FIG. 1 is a diagram showing an example of a processing result of the arrangement estimation process. The left figure of FIG. 1 shows an example of the positional relationship of each lighting device 10 in the lighting space (under the actual environment), and the right figure of FIG. 1 shows an example of the placement estimation result by the placement estimation process.

For example, the arrangement estimation process is performed based on the relative positional relationship between the lighting devices 10 and the arrangement form of each lighting device 10 in the lighting space (under the actual environment). As shown in the right figure of FIG. 1, as a result of the arrangement estimation process, the arrangement position of each icon OB in the user interface EX1 does not correctly reflect the positional relationship of each lighting device 10 in the lighting space (under the actual environment). Cases can occur. Specifically, in the user interface EX1, an icon OBc to which the device ID <3> is assigned is arranged at a position corresponding to the installation position of the lighting device 10a in the lighting space. The device ID <3> is identification information corresponding to the lighting device 10c, and is different from the actual installation position of the lighting device 10c in the lighting space. Further, in the user interface EX1, an icon OBa to which the device ID <1> is assigned is arranged at a position corresponding to the installation position of the lighting device 10b in the lighting space. The device ID <1> is identification information corresponding to the lighting device 10a, and is different from the actual installation position of the lighting device 10 in the lighting space. Although details are omitted, the icon OBd to which the device ID <4> is assigned and the icon OBb to which the device ID <2> are assigned are also different from the actual installation positions of the lighting device 10 in the lighting space. In this way, the icon OB may be arranged in an erroneous positional relationship such that the correct positional relationship of each lighting device 10 in the lighting space (under the actual environment) is rotated around a predetermined rotation axis.

Therefore, in order to prevent the arrangement inconsistency as shown in FIG. 1, before executing the above-mentioned arrangement estimation process, the reference of the arrangement estimation process (hereinafter referred to as “reference”” from the plurality of icon OBs arranged on the user interface (hereinafter, A method of selecting the icon OB to be referred to as “anchor”) and pre-positioning it on the user interface can be considered. FIG. 2 is a diagram showing an example of a processing result of an arrangement estimation process using an anchor. The lower left figure of FIG. 2 shows a state in which the icon OBa corresponding to the lighting device 10a is set as an anchor. The upper right figure of FIG. 2 shows an example of the positional relationship of each lighting device 10 in the lighting space (under the actual environment), and the lower right figure of FIG. 2 shows the arrangement processing result when the icon OBa is set as an anchor. An example is shown. When the icon OBa corresponding to the lighting device 10a is set as the anchor, the operator (for example, the operator U01) visually confirms the installation position of the lighting device 10a in the lighting space (under the actual environment), for example. Further, the operator associates the device ID <1> with the icon OBa arranged at the position corresponding to the installation position of the lighting device 10a in the lighting space in the user interface EX2. Further, the operator positions the placement position of the icon OBa in the user interface so that the placement estimation process is executed in a state where the placement position of the icon OBa is given in advance.

As described above, even if the anchor is set in advance and the placement estimation process is performed, the placement position of each icon OB in the user interface EX2 is in the lighting space (under the actual environment) as shown in the lower right figure of FIG. It may happen that the arrangement does not correctly reflect the positional relationship of each lighting device 10. Specifically, in the user interface EX2, the icon OBc to which the device ID <3> is assigned is arranged at the position corresponding to the installation position of the lighting device 10b in the lighting space. The device ID <3> corresponds to the lighting device 10c and is different from the actual installation position of the lighting device 10c in the lighting space. Further, in the user interface EX2, an icon OBb to which the device ID <2> is assigned is arranged at a position corresponding to the installation position of the lighting device 10c in the lighting space. The device ID <2> corresponds to the lighting device 10b and is different from the actual installation position of the lighting device 10b in the lighting space. As described above, even if the anchor is set before executing the above-mentioned arrangement estimation process, the icon OB may be arranged in an erroneous positional relationship such as a mirror image.

As described above, when the above-mentioned icons are arranged on the user interface based on the relative positional relationship between the lighting devices 10, the positional relationship of each lighting device 10 in the actual environment is correctly reflected. It is very difficult to achieve the placement. In addition, by selecting a plurality of anchors from a plurality of icons on the user interface and then executing the placement estimation process, the placement that correctly reflects the positional relationship of each lighting device 10 in the lighting space (under the actual environment) can be obtained. The possibility of being realized can be increased. However, as the number of anchors selected increases, the workload of the operator increases, and the benefit of reducing the workload by the placement estimation process cannot be sufficiently obtained. Therefore, in the embodiment described below, a method of efficiently providing information that reflects the positional relationship of the lighting device in the lighting space (under the actual environment) as accurately as possible will be described. The embodiments described below will be described by taking a plurality of lighting devices 10 installed in the lighting space as an example, but the same applies to cameras, radars, and various sensors that are expected to be installed in a plurality of spaces. can.

<Overview of information processing system SYS>
Hereinafter, an outline of the information processing system according to the embodiment will be described with reference to the drawings. In the embodiments described below, a plurality of components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numerals. For example, the illuminating device 10 and the like having substantially the same functional configuration will be described separately as necessary, such as the illuminating device 10a and the illuminating device 10b. Further, when it is not necessary to particularly distinguish each of the plurality of components having substantially the same functional configuration, the description will be made without distinguishing them by adding only the same reference numerals. For example, when it is not necessary to particularly distinguish the lighting device 10a, the lighting device 10b, and the like, they are simply collectively referred to as the lighting device 10.

FIG. 3 is a diagram showing an outline of an information processing system according to an embodiment. FIG. 4 is a plan view of the arrangement of the plurality of lighting devices shown in FIG. 3 from a bird's-eye view. As shown in FIG. 3, the information processing system SYS according to the embodiment includes a plurality of lighting devices 10 and an information processing device 20.

In the information processing system SYS shown in FIG. 3, the plurality of lighting devices 10 and the information processing device 20 are communicably connected via a predetermined network such as a wireless LAN (Local Area Network). The predetermined network may be a wireless LAN used in facilities such as offices, homes, studios and theaters to which the information processing system SYS is introduced, or may be the Internet. Further, the information processing device 20 may be connected to the plurality of lighting devices 10 from the outside of the lighting space in which the plurality of lighting devices 10 are arranged.

The lighting device 10 is a lighting device using a semiconductor light emitting element such as an LED (Light Emitting Diodes) as a light source. For example, the lighting device 10 is used by being arranged on the ceiling, being suspended at a predetermined position in the lighting space by a suspension device called a baton, or being placed at a predetermined position. When the illuminating device 10 is arranged on the ceiling, the illuminating device 10 is, for example, a base light, a downlight, or a ceiling light. Further, when the illuminating device 10 is lowered by the suspension device or placed in a predetermined position, the illuminating device 10 is, for example, a spotlight, a border light, or a horizont light. Further, as shown in FIG. 4, for example, the lighting devices 10a to 10l are arranged in four vertical rows and three horizontal rows, and three in the vertical row and four in the horizontal row in a plan view, for a total of 12 units. It is organized by a table lighting device 10. Further, each lighting device 10 has a wireless communication function capable of transmitting and receiving a wireless signal to and from another lighting device 10 (all other lighting devices 10 regardless of whether they are adjacent to each other). Have. Further, each lighting device 10 has a function of measuring (measuring) the reception intensity of the radio signal received from the other lighting device 10 and a function of recording the reception intensity of the radio signal received from the other lighting device 10.

The information processing device 20 is an information processing device having a communication function and a display function. For example, the information processing device 20 performs work such as associating a device ID individually assigned to each of the lighting devices 10 as identification information of the lighting device 10 with an icon OB arranged on the user interface. It is a device used by an operator (for example, operator U01) who performs the operation. The information processing device 20 is typically a portable electronic device such as a smartphone, a tablet, a notebook PC (Personal Computer), or a remote controller.

<Information processing example in information processing system SYS>
Hereinafter, an example of information processing in the information processing system SYS according to the embodiment will be described. The information processing device 20 transmits a control signal instructing each lighting device 10 to transmit and receive wireless signals to and from the other lighting devices 10. Each lighting device 10 transmits and receives a wireless signal to and from another lighting device 10 according to a control signal from the information processing device 20.

For example, when the lighting device 10a shown in FIG. 3 is the transmitting side, a wireless signal including an ID (device ID) is transmitted from the lighting device 10a to the surroundings. Then, the lighting devices 10b, 10c, 10d and the like arranged around the lighting device 10a receive the radio signal. That is, wireless signals are transmitted and received between the lighting devices 10a and the lighting devices 10b, 10c, 10d, etc., with the lighting devices 10b, 10c, 10d, etc. as the receiving side. Then, in the lighting devices 10b, 10c, and 10d that have received the radio signal from the lighting device 10a, the reception strength of the received radio signal is measured, and the reception strength of the radio signal is recorded in association with the ID. Subsequently, the subject of transmission / reception is switched. For example, with the lighting device 10b as the transmitting side and the lighting devices 10a, 10c, 10d and the like as the receiving side, wireless signals are transmitted and received between the lighting devices, and the lighting devices a, 10c and 10d receive the received wireless signals. The intensity is measured and the reception intensity of the radio signal is recorded in association with the ID. In this way, the wireless signals are transmitted and received to each other in all the lighting devices 10, and each lighting device 10 has each device ID indicating each of the transmitting side and the receiving side of the wireless signal and the measured value of the receiving intensity of the wireless signal. Reception strength information including and is recorded. The transmission / reception of wireless signals from each of the lighting devices is performed, for example, by using a command (instruction) from the information processing device 20 as a trigger. Specifically, all the lighting devices 10 are normally on standby in a state where they can receive radio signals, and the information processing device 20 transmits a signal transmission command to a certain lighting device 10 to transmit a radio signal. Transmission operation is performed. This is realized by sequentially switching the lighting devices 10 to which the signal transmission command is transmitted.

Further, the information processing device 20 issues a command (instruction) to each lighting device 10 to transmit the reception intensity information and the ID information recorded by each lighting device 10, so that the reception intensity described above from each lighting device 10 is transmitted. Gather information. Further, the information processing device 20 estimates the relative positional relationship between the lighting devices 10 by converting the reception intensity included in the reception intensity information into a distance. The conversion of the reception intensity into the distance can be realized by using a known method. Instead of converting the reception intensity into a distance, the information processing device 20 is located between the lighting devices 10 based on the position information (coordinates) indicating the actual position of the lighting device 10 in the lighting space (under the actual environment). The distances may be calculated respectively.

Further, the information processing device 20 displays a user interface in which a plurality of virtual objects corresponding to each of the plurality of lighting devices 10 are arranged according to a predetermined arrangement form. 5 to 8 are diagrams showing an image display example of the user interface according to the embodiment.

As shown in FIG. 5, on the user interface 23U displayed on the display unit 23 of the information processing device 20, icons OBa to OBl, which are a plurality of virtual objects corresponding to each of the plurality of lighting devices 10, are formed. Have been placed. The icons OBa to OBl are arranged on the user interface according to the arrangement form information indicating the actual arrangement form of the plurality of lighting devices 10 in the lighting space (under the actual environment). In the example shown in FIG. 5, for example, according to the arrangement form of the plurality of lighting devices 10 shown in FIG. 4, they are arranged in 4 vertical rows and 3 horizontal rows, 3 in each vertical row, and 4 in each horizontal row. A total of 12 icons OBa to OBl organized by the icon OB are arranged on the user interface 23U. At this point, the icons OBa to OBl are only arranged according to the arrangement form, and the device ID is not linked. Further, as shown in FIG. 5, an ID list in which device IDs collected from the lighting device 10 are listed is displayed on the user interface 23U. The device ID can be extracted from, for example, the reception intensity information collected from the lighting device 10. By the arrangement estimation process described above, each of the device IDs displayed in the list is associated with any of the icons OBa to OBl.

Further, the information processing apparatus 20 should position the icon OB in the user interface in advance as a reference (anchor) for the arrangement estimation process from among the plurality of icon OBs arranged on the user interface before executing the above-mentioned arrangement estimation process. Is derived according to the arrangement form of each lighting device 10 in the lighting space (under the actual environment), and is proposed to the operator.

Specifically, the information processing device 20 analyzes the arrangement form of the plurality of lighting devices 10 and derives at least one icon OB suitable as a reference for the arrangement estimation process described above. For example, as shown in FIG. 4, in the information processing apparatus 20, a plurality of lighting devices 10 are arranged in four vertical rows and three horizontal rows, and three units are arranged in the vertical row and four units are arranged in the horizontal row. In the case of the existing arrangement form, first, the icon OBa and the icon OBe are derived as the icon OB that functions as the reference (anchor) of the arrangement estimation process. Then, as shown in FIG. 5, in order to propose to the operator that the icon OBa and the icon OBe are positioned as anchors, the information processing apparatus 20 displays the icon OBa and the icon OBe arranged on the user interface 23U. Is changed to a diagonal line pattern different from that of other icons OB, and a message window 23W is displayed on the user interface 23U. For example, the information processing apparatus 20 prompts the message window 23W to set an anchor and displays a message for notifying the operator that the icon OB of the diagonal line pattern is recommended as an anchor. In this way, the information processing apparatus 20 can easily make the operator recognize the icon to be manually positioned on the user interface in advance before executing the arrangement estimation process described above.

As an anchor setting method, the operator (for example, the operator U01) selects one of the device IDs on the ID list, transmits a control signal instructing the lighting to be turned on with the selected device ID as the destination, and transmits the lighting space (for example, the lighting space (operator U01). Visually check the lighting device 10 that actually lights up in the actual environment). Then, when the position of the lit lighting device 10 and the arrangement position of the icon OB on the user interface recommended as an anchor correspond to each other, the operator sets the arrangement position of the icon OB on the user interface. At the same time as positioning, the device ID selected on the ID list is associated. In the example shown in FIG. 6, the operator positions the position of the icon OBe on the user interface 23U, and the device ID <1> is associated with the icon OBe. The information processing apparatus 20 changes the display mode of the icon OBe positioned on the user interface by the operator to a display mode (for example, a grid pattern) different from that of other icon OBs.

Further, the information processing apparatus 20 proposes an icon OB to be positioned next according to the position of the positioned icon OB. For example, as shown in FIG. 6, in order to propose the icon OB to be positioned next to the operator, the information processing apparatus 20 displays the icon OBi according to the arrangement position of the icon OBe positioned on the user interface 23U. Change the aspect to a diagonal line pattern. Further, the information processing apparatus 20 changes the content of the message in the message window 23W according to the positioning of the arrangement position of the icon OBe. For example, the information processing apparatus 20 prompts the message window 23W to set an anchor and displays a message for notifying the operator that the icon OB of the diagonal line pattern is recommended as an anchor. As a result, the information processing apparatus 20 can provide a plurality of options as icons to be positioned by the operator, and can reduce the work load of the operator to no small extent.

Further, when the icon OBe is positioned by the operator by the same procedure as described above, the information processing apparatus 20 further proposes the icon OB to be positioned next. For example, as shown in FIG. 7, the information processing apparatus 20 proposes to the operator the icon OB to be positioned next, so that the user can arrange the icon OBe and the icon OBi positioned on the user interface 23U. The display mode of the icon OBc, the icon OBd, the icon OBg, and the icon OBh on the interface 23U is changed to a diagonal line pattern different from that of the other icon OBs. Further, the information processing apparatus 20 changes the content of the message in the message window 23W according to the positioning of the arrangement position of the icon OBi. For example, the information processing apparatus 20 prompts the additional setting of the anchor and displays a message for notifying the operator that the icon OB of the diagonal line pattern is recommended as the anchor.

As described above, the information processing apparatus 20 proposes to the operator an appropriate anchor setting according to the arrangement form of the lighting device 10 in the lighting space (under the actual environment) before executing the arrangement estimation process described above. It is possible to efficiently provide information that reflects the positional relationship of the lighting device in the lighting space as accurately as possible.

Further, as shown in FIG. 8, when the information processing apparatus 20 completes the setting of all the anchors proposed to the operator, the information processing apparatus 20 displays an inquiry message on the message window 23W as to whether or not to execute the above-mentioned arrangement estimation process. , Wait for instructions from the operator. In the example shown in FIG. 8, the message window 23W is provided with a button 23B ₁ operated by the operator when executing the placement estimation process and a button B ₂ operated by the operator when returning to the positioning operation of the icon OB. There is. When the display unit 23 of the information processing apparatus 20 is composed of a touch panel display, the operator can touch the button B with a finger, a stylus pen, or the like. Further, when the display unit 23 of the information processing device 20 is composed of a display that is basically operated by a pointing device, the operator operates the button B with a cursor or the like that can be operated via a mouse, a keyboard, a touch pad, or the like. can. The example in which the button B is provided in the message window 23W is not particularly limited, and may be provided on the user interface 23U separately from the message window 23W. Further, the operation input corresponding to the button B may be realized by a predetermined touch gesture specified in advance.

Further, when the information processing apparatus 20 receives an execution instruction of the arrangement estimation process from the operator (for example, the operator U01), the arrangement form of each lighting device 10 in the lighting space (under the actual environment) and the relative between the lighting devices 10 An arrangement estimation process for associating the icon OB with the identification information of the lighting device 10 corresponding to the icon OB is executed based on the positional relationship. Specifically, the information processing device 20 uses the icon OB (anchor) positioned in advance in the user interface as a reference for the placement estimation process, and the relative positional relationship of each lighting device 10 and the lighting space (under the actual environment). The arrangement form of the plurality of lighting devices 10 in the above is processed according to the optimization algorithm, and the icon OB and the device ID are automatically associated according to the processing result.

Further, as shown in FIG. 9, the information processing apparatus 20 displays an image on the user interface 23U in which the apparatus ID is assigned to a plurality of icon OBs corresponding to each of the lighting apparatus 10 as the arrangement estimation result. do.

Further, the information processing apparatus 20 proposes an icon OB to be positioned when the arrangement estimation process is executed again from among the plurality of icon OBs arranged in the user interface as a result of the arrangement estimation process. For example, as shown in FIG. 9, the information processing apparatus 20 changes the display mode of the icon OBf, the icon OBg, the icon OBj, and the icon OBk on the user interface 23U to a vertical line pattern different from other icon OBs. do. As a result, the number of times the estimation process is redone can be reduced, and the work load of the operator can be reduced to a considerable extent.

Further, the information processing apparatus 20 changes the content of the message in the message window 23W when displaying the result of the arrangement estimation process shown in FIG. 9 on the user interface 23U. For example, as shown in FIG. 9, when the information processing apparatus 20 has many errors in associating the apparatus ID, a message suggesting that the icon OB of the vertical line pattern is set as an anchor and the estimation process is executed again is sent. indicate. As a result, the information processing apparatus 20 can easily make the operator recognize the icon to be manually positioned on the user interface in advance when the arrangement position estimation is redone.

The operator (for example, the operator U01) confirms whether or not the association between the arrangement position of the icon OB displayed on the user interface and the device ID of the lighting device 10 is correct. For example, the device ID is selected from the ID list displayed on the user interface 23U shown in FIG. 9, the position of the lighting device 10 to be lit in the lighting space (under the actual environment), and the icon OB displayed on the user interface. Visually check whether the position corresponds. If there are many errors in the association between the icon OB placement position and the device ID of the lighting device 10, the operator positions the icon OB as an anchor from the vertical line pattern icon OB, and performs the above-mentioned placement estimation process. Can be executed again. The device IDs listed in the ID list shown in FIG. 9 may be automatically rearranged when displaying the arrangement estimation process so that the device IDs corresponding to the icon OBa are displayed in order from the top. .. That is, in the example shown in FIG. 9, the device IDs are arranged in ascending order from the top of the ID list, such as "1", "2", "3", (hereinafter omitted), but from the top of the ID list. The icons may be automatically rearranged and displayed in the order of "8", "12", "9", "11", (hereinafter omitted), icon OBa → icon OBc → icon OBc → (hereinafter omitted). .. As a result, the operator can easily find an error when visually confirming the correspondence between the icon and the device ID.

<Configuration example of information processing system SYS>
Hereinafter, a configuration example of the information processing system SYS according to the embodiment will be described. FIG. 10 is a diagram showing a configuration example of an information processing system according to an embodiment. The configuration of the information processing system SYS according to the embodiment is not particularly limited to the example shown in FIG. 10, and may have more lighting devices 10 than the example shown in FIG.

As shown in FIG. 10, the information processing system SYS according to the embodiment basically has the same configuration as the information processing system 1A according to the embodiment, except that the number of lighting devices 10 constituting the system is large. There is. The plurality of lighting devices 10 and the information processing device 20 are connected to the network NT by a combination of wired or wireless, wired and wireless. The lighting device 10 and the information processing device 20 can communicate with each other through the network NT. Network NT includes wireless LAN (Local Area Network) based on standards such as Bluetooth (registered trademark) and WiFi (registered trademark), the Internet, and the like.

The lighting device 10 is a lighting device using a semiconductor light emitting element such as an LED (Light Emitting Diodes) as a light source. For example, the lighting device 10 is used by being suspended at a predetermined position in a lighting space or placed at a predetermined position by a suspension device called a baton. The lighting device 10 has a wireless communication function capable of transmitting and receiving wireless signals to and from another lighting device 10 via a network NT. Further, the lighting device 10 has a function of measuring and recording the reception intensity of the radio signal received from the other lighting device 10.

The information processing device 20 is an information processing device having a communication function and a display function. For example, the information processing device 20 is an operator (for example, operator U01) that performs work such as associating a device ID individually assigned to each of the lighting devices 10 with an icon OB arranged on the user interface. Is the device used by. The information processing device 20 is a portable electronic device such as a smartphone, a tablet, or a node-type personal computer (PC).

<Configuration example of each device of the information processing system SYS>
<Configuration example of lighting device 10>
Hereinafter, a configuration example of the lighting device 10 according to the embodiment will be described with reference to FIG. 11. FIG. 11 is a block diagram showing a configuration example of the lighting device according to the embodiment. Note that FIG. 11 shows an example of the functional configuration of the lighting device 10 according to the embodiment, and is not particularly limited to the example shown in FIG.

As shown in FIG. 11, the lighting device 10 includes a communication unit 11, a light emitting unit 12, a storage unit 13, and a control unit 14.

The communication unit 11 communicates with various devices such as the information processing device 20 via the network NT. Further, the communication unit 11 transmits / receives a wireless signal to / from another lighting device 10 via the network NT. The communication unit 11 is realized by a communication module or the like for communicating with the communication unit 11 through the network NT. A wireless signal including its own ID information is transmitted to another lighting device 10, and a wireless signal transmitted from the other lighting device 10 is received. Further, the communication unit 11 transmits the reception strength information of the wireless signal to the information processing device 20. Further, the communication unit 11 includes an intensity measuring unit that measures the intensity of the radio signal received from the other lighting device 10.

The light emitting unit 12 has a light source whose illuminance and color temperature can be adjusted. The light emitting unit 12 is, for example, an SMD (Surface Mount Device) type or COB (Chip on Board) type light source. The light emitting unit 12 is configured by arranging one or a plurality of LED (Light Emitting Diode) light sources on a substrate (base). The LED light source is, for example, a white light source that irradiates white light. Further, the LED light source may have two or more types of white light sources (for example, light bulb color and neutral white), a white light source, and a chromatic light source that emits chromatic colors such as red, green, and blue. May have. For example, the control unit 14 independently controls each of these light sources according to the control content of the lighting received from the information processing apparatus 20, and arbitrarily controls dimming and toning by changing the ratio and intensity of light emission. It may be in the form of

The storage unit 13 stores programs and data required for each process executed by the lighting device 10. The storage unit 13 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk.

The storage unit 13 has an identification information storage unit 13a and a reception strength information storage unit 13b. The identification information storage unit 13a and the reception intensity information storage unit 13b may be arranged in one semiconductor memory element or storage device, or may be arranged in different semiconductor memory elements or storage devices, respectively.

The identification information storage unit 13a stores the device ID, which is the identification information individually assigned in advance to the lighting device 10 which is its own device.

The reception intensity information storage unit 13b stores reception intensity information regarding the reception intensity of the radio signal transmitted / received to / from the other lighting device 10. For example, the reception strength information stored in the reception strength information storage unit 13b includes a transmission side ID, which is a device ID individually assigned to another lighting device 10 on the transmission side of the radio signal, and reception of the radio signal. The receiving side ID, which is a device ID individually assigned to the own device on the side, and the measured value of the reception strength of the radio signal are associated with each other.

The control unit 14 has an internal memory for storing a program defining various processing procedures and the like and required data, and executes various processing by these. The control unit 14 is mounted by a microcomputer or the like. The microcomputer is equipped with a processor such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores a program for controlling each part of the lighting device 10 and an application for executing various processes. When a processor such as a CPU executes a program or application stored in the ROM, control of the lighting device 10 by a microcomputer and various functions are realized. The RAM is used as a memory area required for executing operations by a processor such as a CPU. The control unit 14 may realize control of the lighting device 10 and various functions by reading a program or the like stored in the storage unit 13 and executing the read program. Further, the control unit 14 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

As shown in FIG. 11, the control unit 14 has a storage control unit 14a and a transmission control unit 14b. Although not shown in FIG. 11, the control unit 14 includes a lighting control unit that controls the light emitting unit 12. The storage control unit 14a records the reception intensity information received from each lighting device 10 in the reception intensity information storage unit 13b. For example, the storage control unit 14a transmits and receives a wireless signal to and from another lighting device 10 via the communication unit 11 in accordance with an instruction from the information processing device 20. Further, when the own device is the receiving side of the radio signal, the storage control unit 14a organizes the measured value obtained by measuring the reception intensity of the radio signal received from each of the other lighting devices 10 and the above-mentioned transmitting side ID. , It is recorded in the reception strength information storage unit 13b as reception strength information in association with the reception side ID (device ID of the own device) which is the reception side of the radio signal.

In response to a request from the information processing device 20, the transmission control unit 14b transmits the reception strength information stored in the reception strength information storage unit 13b to the information processing device 20 via the communication unit 11.

<Configuration example of information processing device 20>
Hereinafter, a configuration example of the information processing apparatus 20 according to the embodiment will be described. FIG. 12 is a block diagram showing a configuration example of the information processing apparatus according to the embodiment. Note that FIG. 12 shows an example of the functional configuration of the information processing apparatus 20 according to the embodiment, and is not particularly limited to the example shown in FIG.

As shown in FIG. 12, the information processing apparatus 20 includes an information communication unit 21, an input unit 22, a display unit 23, an information storage unit 24, and an information control unit 25.

The information communication unit 21 communicates with various devices such as the lighting device 10 via the network NT. The information communication unit 21 is realized by a communication module or the like for communicating through the network NT. The information communication unit 21 transmits a control signal instructing each lighting device 10 to transmit and receive wireless signals to and from the other lighting devices 10. Further, the information communication unit 21 receives reception intensity information from each lighting device 10.

The input unit 22 receives an operation input of an operator (for example, operator U01) who uses the information processing device 20. The input unit 22 is realized by, for example, an input device such as a keyboard, a mouse, or a touch panel. The input unit 22 receives, for example, an operation input to the user interface displayed on the display unit 23 for performing various settings and controls of the lighting device 10. The operation input received by the input unit 22 includes an operation for associating a device ID with a plurality of icons (for example, icon OB) corresponding to each lighting device 10 arranged on the user interface, or an operation on the user interface. There are operations for grouping the lighting devices 10 performed through the icons.

The display unit 23 displays various information related to various settings and controls of the lighting device 10 executed by the information processing device 20. The display unit 23 is realized by, for example, a display device such as a liquid crystal monitor or a liquid crystal display. The display unit 23 displays a user interface 23U (see FIGS. 5 to 9) for performing various settings and controls of the lighting device 10.

The information storage unit 24 stores a program or the like for realizing the control realized by the information control unit 25. The information storage unit 24 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk.

As shown in FIG. 12, the information storage unit 24 includes a distance calculation application storage unit 24a, a reception strength information storage unit 24b, a drawing information storage unit 24c, and an estimation application storage unit 24d. The distance calculation application storage unit 24a, the reception strength information storage unit 24b, the drawing information storage unit 24c, and the estimation application storage unit 24d may be arranged in one semiconductor memory element or storage device, respectively. It may be arranged in different semiconductor memory elements or storage devices.

The distance calculation application storage unit 24a stores a distance calculation application (hereinafter, referred to as a “distance calculation application”) that provides a function for calculating an estimated distance between the lighting devices 10. The distance calculation application provides a function for transmitting a control signal instructing each lighting device 10 to send and receive wireless signals to and from another lighting device 10. Further, the distance calculation application provides a function for collecting reception intensity information from each lighting device 10. Further, the distance calculation application provides a function for calculating the estimated distance between the lighting devices 10 from the reception intensity information included in the reception intensity information.

The reception intensity information storage unit 24b stores the reception intensity information received from each lighting device 10. The reception intensity information stored in the reception intensity information storage unit 24b is a transmission side ID which is a device ID individually assigned in advance to another lighting device 10 which is a transmission side of the radio signal, and a reception side of the radio signal. The receiving side ID, which is a device ID individually assigned to the own device in advance, and the information on the reception strength of the radio signal are associated with each other.

The drawing information storage unit 24c stores drawing information regarding the layout and the like of the lighting device 10 set in the lighting space. The drawing information shows position information indicating the installation position (coordinates) of the lighting device 10 in the lighting space (under the actual environment) in which the plurality of lighting devices 10 are actually installed, and the arrangement form of the plurality of lighting devices 10. Arrangement form information is included. The arrangement form information is arranged in four vertical rows and three horizontal rows in a plan view, and is organized by three icons in each vertical row and four icons in each horizontal row in order to specify the arrangement form. Contains information about.

The estimation application storage unit 24d stores an estimation application (hereinafter, referred to as "estimation application"). In addition, the estimation application sets an icon that should be positioned in advance in the user interface as a reference (anchor) for the placement estimation process from among a plurality of icons placed in the user interface before executing the above-mentioned placement estimation process. It provides a function for deriving and proposing to the operator according to the actual arrangement form of the lighting device 10 in the actual environment). Further, the estimation application provides a function of executing the above-mentioned arrangement estimation process.

The information control unit 25 has an internal memory for storing a program defining various processing procedures and the like and required data, and executes various processing by these. The information control unit 25 is implemented by a microcomputer or the like. The microcomputer is equipped with a processor such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores a program for controlling each part of the information processing apparatus 20 and an application for executing various processes. When a processor such as a CPU executes a program or application stored in the ROM, control of the information processing apparatus 20 by a microcomputer and various functions are realized. The RAM is used as a memory area required for executing operations by a processor such as a CPU. The information control unit 25 can also control the information processing apparatus 20 and realize various functions by reading a program or the like stored in the information storage unit 24 and executing the read program. Further, the information control unit 25 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

As shown in FIG. 12, the information control unit 25 includes a collection unit 25a, a calculation unit 25b, a proposal unit 25c, and an estimation unit 25d.

The collecting unit 25a transmits a control signal instructing each lighting device 10 to transmit and receive wireless signals to and from the other lighting devices 10 based on the function provided by the distance calculation application. Processing can be realized. For example, the collecting unit 25a requests each lighting device 10 installed in the lighting space (under the actual environment) to transmit the device ID assigned to the own device in advance, and the collecting unit 25a requests that the device ID assigned to the own device be transmitted to each lighting device 10. Collect the device ID. Further, the collecting unit 25a uses the collected device ID to transmit a control signal instructing each of the lighting devices 10 to transmit and receive wireless signals. Further, the collecting unit 25a requests each lighting device 10 to transmit the reception intensity information, and collects the reception intensity information from each lighting device 10.

The calculation unit 25b converts the reception intensity information included in the reception intensity information collected by the collection unit 25a into a distance based on the function provided by the distance calculation application, and calculates the estimated distance between the plurality of lighting devices 10. It is possible to realize the processing to calculate each.

The proposal unit 25c sets an icon to be positioned in advance on the user interface as a reference (anchor) for the placement estimation process from among a plurality of icons placed on the user interface before executing the above-mentioned placement estimation process. It is derived according to the arrangement form of the lighting device 10 in the actual environment) and proposed to the operator.

For example, the proposal unit 25c arranges and displays a plurality of icons corresponding to each of the lighting devices 10 on the user interface according to the arrangement form information indicating the arrangement form of each lighting device 10 in the lighting space (under the actual environment). It is displayed in the unit 23.

Further, the proposal unit 25c changes the display mode of the icon recommended as an anchor from the plurality of icons arranged on the user interface to a display mode different from other icons (for example, a diagonal line pattern) (see FIG. 5). ). Further, the proposal unit 25c displays a message for prompting the setting of an anchor through a message window displayed on the user interface and notifying the operator that an icon having a different display mode is recommended as an anchor (see FIG. 5). .. The proposal unit 25c changes the display mode of the icon OB positioned on the user interface by the operator to a display mode different from other icon OBs (for example, a grid pattern).

Further, the proposal unit 25c proposes an icon to be positioned next according to the arrangement position of the positioned icon. For example, in order to propose the icon to be positioned next to the operator, the proposal unit 25c sets the display mode of the icon to be positioned next to the other icons according to the placement position of the icon positioned on the user interface. Change to a different display mode (for example, a diagonal line pattern) (see FIGS. 6 and 7). Further, the proposal unit 25c displays a message for prompting the setting of an anchor through a message window displayed on the user interface and notifying the operator that an icon having a different display mode is recommended as an anchor (FIGS. 6 and 6). 7).

Further, the proposal unit 25c proposes an icon to be positioned when the arrangement estimation process is executed again from among the plurality of icons arranged on the user interface as a result of the arrangement estimation process described above. For example, the proposal unit 25c changes the display mode of the icon to be positioned when the arrangement estimation process is executed again to a display mode different from other icons (for example, a vertical line pattern). Further, the proposal unit 25c displays a message notifying the operator that an icon having a different display mode is recommended as an anchor when the placement estimation process is executed again through the message window displayed on the user interface (FIG. 9). reference).

The estimation unit 25d executes the above-mentioned arrangement estimation process. Specifically, in the user interface, the estimation unit 25d uses an icon (anchor) positioned in advance by the operator as a reference for the placement estimation process, and the relative positional relationship of each lighting device 10 and the lighting space (under the actual environment). ), The arrangement form of the plurality of lighting devices 10 is processed according to the optimization algorithm, and the icon and the device ID are automatically associated according to the processing result (see FIG. 9). The estimation unit 25d can acquire and use the arrangement form of each lighting device 10 used for the arrangement estimation process from the arrangement form information stored in the drawing information storage unit 24c. Further, the estimation unit 25d may use the estimated distance between the lighting devices 10 calculated by the calculation unit 25b as information for estimating the relative positional relationship between the lighting devices 10 used in the arrangement estimation process. can. This saves the operator the trouble of reading the position information indicating the actual position of each lighting device from the drawing information and manually calculating the distance between the devices.

<Processing procedure by information processing device 20>
The processing procedure of the information processing apparatus 20 according to the embodiment will be described with reference to FIG. FIG. 13 is a flowchart showing an example of the processing procedure of the information processing apparatus according to the embodiment. The processing procedure shown in FIG. 13 is executed by the information control unit 25 included in the information processing apparatus 20.

As shown in FIG. 13, the proposal unit 25c acquires an arrangement form of each lighting device 10 in the lighting space (step S201).

Further, the proposal unit 25c positions the icon OB, which should be positioned as an anchor in the lighting space, as an anchor in the lighting space from among the plurality of icons arranged on the user interface, as illustrated in FIGS. 5 to 7 described above. Is derived according to the arrangement form of the above and proposed to the operator (step S202).

Further, the estimation unit 25d executes the above-mentioned arrangement estimation process (step S203) using the anchor positioned by the operator as a reference for the arrangement estimation process, and ends the processing procedure shown in FIG.

<< Others >>
In the above-described embodiment, the information processing apparatus 20 has described an example of proposing an icon to be positioned in advance in the user interface to the operator as a reference (anchor) for the placement estimation process, but the example needs to be particularly limited to this example. There is no. For example, the information processing apparatus 20 may propose a vector connecting the icons as an anchor.

Further, the processing program or estimation application for realizing the processing function of the information processing apparatus 20 according to the above-described embodiment is stored and distributed in a computer-readable recording medium such as an optical disk, a semiconductor memory, a magnetic tape, or a flexible disk. You may. At this time, for example, the information processing apparatus 20 installs a processing program or an estimation application from the storage medium and executes the above-mentioned various processes.

Further, the above-mentioned processing program or estimation application may be stored in a cloud storage arranged on a network such as the Internet so that it can be downloaded to a computer or the like. Further, the above-mentioned functions may be realized by the collaboration between the OS (Operating System) and the application software. In this case, the part other than the OS may be stored in a medium and distributed, or the part other than the OS may be stored in the cloud storage so that it can be downloaded to a computer or the like.

Further, the processing functions may be distributed so that at least a part of the processing functions of the information processing apparatus 20 according to the above-described embodiment is executed on the cloud server. For example, the cloud server may have a processing function of at least one of the proposal unit 25c and the estimation unit 25d of the information control unit 25 of the information processing device 20. When the cloud server has the processing function of the proposal unit 25c, the information processing apparatus 20 uploads the arrangement form information indicating the arrangement form of each lighting device 10 in the lighting space (under the actual environment) to the cloud server and positions it in advance as an anchor. Request information about the icon to be. In response to the request from the information processing device 20, the cloud server derives an icon to be positioned as an anchor based on the arrangement form of each lighting device 10, and provides the information of the derived icon to the information processing device 20. Further, when the cloud server has the processing function of the estimation unit 25d, the information processing apparatus 20 provides arrangement form information indicating the arrangement form of each lighting device 10 in the lighting space (under the actual environment) and relative between the lighting devices 10. Information on the positional relationship (information on the estimated distance between each lighting device 10) is uploaded to the cloud server, and the result of the placement estimation process is requested. In response to a request from the information processing device 20, the cloud server includes information on the relative positional relationship between the lighting devices 10 and arrangement form information indicating the arrangement form of each lighting device 10 in the lighting space (under the actual environment). The placement estimation process is executed based on the above, and the result of the placement estimation process is provided to the information processing apparatus 20.

Further, among the processes described in the above-described embodiment, all or part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed. It is also possible to automatically perform all or part of the above by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.

Although the embodiments of the present invention have been described above, the embodiments are presented as examples and are not intended to limit the scope of the invention. The embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The embodiments are included in the scope of the invention and the equivalent scope thereof described in the claims as well as included in the scope and gist of the invention. Further, this embodiment can be appropriately combined as long as the processing contents do not contradict each other.

Further, the effects described in the present specification are merely exemplary and not limited, and other effects may be obtained.

10 Lighting device 20 Information processing device 21 Information communication unit 22 Input unit 23 Display unit 24 Information storage unit 24a Distance calculation application storage unit 24b Reception strength information storage unit 24c Drawing information storage unit 24d Estimated application storage unit 25 Information control unit 25a Collection unit 25b Calculation part 25c Proposal part 25d Estimation part

Claims (6)

A display unit that displays a user interface in which a plurality of virtual objects corresponding to each of the plurality of devices are arranged according to the arrangement form of the plurality of devices in a real environment;
Before executing the placement estimation process for associating the virtual object with the identification information corresponding to the virtual object, the placement estimation is performed from the plurality of virtual objects placed in the user interface. With a proposal unit that derives an object to be positioned in advance on the user interface according to the arrangement form and proposes it to the operator in order to function as a processing reference.
An information processing device characterized by being equipped with. The proposal section
The information processing apparatus according to claim 1, wherein the object to be positioned next is proposed according to the arrangement position of the positioned object. The proposal section
A claim characterized by proposing an object to be positioned from among the plurality of virtual objects arranged in the user interface as a result of the arrangement estimation process when the arrangement estimation process is executed again. The information processing apparatus according to 1 or 2. The information processing device according to any one of claims 1 to 3, wherein the plurality of devices are lighting devices. Information processing equipment
A display process for displaying a user interface in which a plurality of virtual objects corresponding to each of the plurality of devices are arranged according to the arrangement form of the plurality of devices in a real environment;
Before executing the placement estimation process for associating the virtual object with the identification information corresponding to the virtual object, the placement estimation is performed from the plurality of virtual objects placed in the user interface. With the proposal process of deriving an object to be positioned in advance on the user interface according to the arrangement form and proposing it to the operator in order to function as a processing reference;
An information processing method characterized by executing. For information processing equipment
A display procedure for displaying a user interface in which a plurality of virtual objects corresponding to each of a plurality of devices are arranged according to the arrangement form of the plurality of devices in a real environment;
Before executing the placement estimation process for associating the virtual object with the identification information corresponding to the virtual object, the placement estimation is performed from the plurality of virtual objects placed in the user interface. With the proposed procedure of deriving an object to be positioned in advance on the user interface according to the arrangement form and proposing it to the operator in order to function as a processing reference;
An information processing program characterized by executing.

Images