JP2021033907A - Display system and control method thereof - Google Patents

Abstract

To provide a display system capable of satisfactorily displaying an object to users surrounding a display unit provided on a table.SOLUTION: A display system comprises a display unit displaying an object, a calculation unit calculating the number of users around the display unit and positions thereof on the basis of output signals of sensors placed around the display unit, an identification unit identifying each of the users around the display unit, a storage unit storing a reference list in which individual information about a plurality of users is registered, and a control unit adjusting a display position and direction of the object on the basis of a result of comparing the identification information identified by the identification unit with the reference list to display the object in the display unit.SELECTED DRAWING: Figure 14

Description

The present invention relates to a display system and a control method thereof.

There is known a display device in which the upper surface of a table used by a plurality of people is a display panel (see, for example, Patent Document 1). According to Patent Document 1, distance sensors are provided on each side of the rectangular table, and the display position of the object is determined based on the distance to the seated user.

Japanese Unexamined Patent Publication No. 2013-214259

In the case of a display table such as a circular table in which the number of surrounding users is fluid, it is difficult to display objects well to the users surrounding the display table.

The present invention has been made to solve such a problem, and provides a display system or the like capable of displaying an object satisfactorily to a user who surrounds a display unit provided on a table. The purpose.

The display system according to the first aspect of the present invention calculates the number of users around the display unit and their respective positions based on the display unit that displays the object and the output signal of the sensor arranged around the display unit. A calculation unit, an identification unit that personally identifies each user around the display unit, a storage unit that stores a reference list in which personal information of a plurality of users is registered, and a number of users calculated by the calculation unit. It is provided with a control unit that adjusts the display position and orientation of the object based on the result of comparing the identification information identified by the identification unit with the reference list and displays the object on the display unit. The control method according to the second aspect of the present invention is a control method of a display system including a display unit for displaying an object and a storage unit for storing a reference list in which personal information of a plurality of users is registered. A calculation step of calculating the number of users around the display unit and their respective positions based on the output signals of sensors arranged around the unit, and an identification step of personally identifying each user around the display unit. , The number and position of users calculated in the calculation step, and the control step that adjusts the display position and orientation of the object based on the result of comparing the identification information identified in the identification step with the reference list and displays it on the display unit. Has.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a display system or the like capable of displaying an object satisfactorily to a user who surrounds a display unit provided on a table.

It is a perspective view which shows the appearance that a plurality of users surround the display table of the display system which concerns on this embodiment. It is a control block diagram of the display system which concerns on 1st Embodiment. It is a figure which shows the relationship between a user and an object display. It is a figure which shows the change of the object display when a part of users move. It is a figure which shows the change of the object display when some users move out. It is a figure which shows an example of the change of the object display when the voice instruction is recognized. It is a flow chart which shows the processing flow of the display system which concerns on 1st Example. It is a figure which shows the relationship between the user and the object display which concerns on 2nd Example. It is a figure which shows the relationship between a user and an object display when the object to be displayed is large. It is a figure which shows another example of a user and an object display when the object to be displayed is large. It is a flow chart which shows the processing flow of the display system which concerns on 2nd Example. It is a control block diagram of the display system which concerns on 3rd Example. This is an example of the reference list to be referenced when adjusting the object display. It is a figure which shows the relationship between a user and an object display. It is a figure which shows the relationship between a user and an object display when the object to be displayed is large. It is a figure which shows the relationship between a user and an object display when the object to be displayed is larger. It is a flow chart which shows the processing flow of the display system which concerns on 3rd Example. It is a control block diagram of the display system which concerns on 4th Embodiment. It is a figure which shows the relationship between a user and an object display. It is a flow chart which shows the processing flow of the display system which concerns on 4th Embodiment. It is a figure which shows the state of the display table and the user which concerns on 5th Example. It is a figure for demonstrating the distortion processing of an object. It is a figure which shows the relationship between a user and an object display. This is another example of the reference list to be referenced when adjusting the object display. It is a flow chart which shows the processing flow of the display system which concerns on 5th Example.

Hereinafter, the present invention will be described through embodiments of the invention, but the invention according to the claims is not limited to the following embodiments. Moreover, not all of the configurations described in the embodiments are indispensable as means for solving the problem.

FIG. 1 is a perspective view showing a state in which a plurality of users surround the display table 100 of the display system according to the present embodiment. The display system according to the present embodiment can be configured so that the display table includes substantial elements for realizing the function, but some elements are connected via the Internet, short-range wireless communication, or the like. It can also be arranged in an external device to be installed. Therefore, in the display system, the display table becomes the display system itself when a substantial element is built in, and when some elements are entrusted to an external device, the entire display system including those external devices is displayed. It becomes. In the following embodiment, a display system including a display table 100 and an external device will be described.

The display table 100 has a circular desk shape suitable for meetings, for example, and has a size such that a plurality of users seated in chairs can surround the surroundings. The top surface of the display table 100 is, for example, the display surface of the display panel 120, which is a liquid crystal panel, and can display a document in which an electronic file is developed, a digital image, or the like as an object. A user who surrounds the display table 100 can hold a meeting or enjoy a chat while looking at the objects displayed on the display table 100.

Three microphones 110a, 110b, and 110c are provided around the top surface at equal intervals, and each of these microphones collects the voice of the user. As will be described in detail later, the display table 100 analyzes the sounds collected by these microphones to grasp the situation, adjusts the display position and orientation of the object according to the analyzed situation, and displays the object on the display panel 120. .. The present embodiment will be described below through some examples.

First, the first embodiment will be described. FIG. 2 is a control block diagram of the display system according to the first embodiment. The display table 100 mainly includes a microphone 110, a display panel 120, a touch panel 130, a speaker 140, a calculation unit 150, an object storage unit 170, a memory 180, and a communication unit 190. The microphones 110 are three microphones 110a, 110b, and 110c dispersedly arranged around the top surface of the display table 100 as described above, and convert the collected sound into a digital signal and transmit it to the arithmetic unit 150. To do. As described above, the display panel 120 is, for example, a liquid crystal panel, and converts a video signal received from the calculation unit 150 into a visible video and displays it. The video signal includes the above-mentioned object, and in this embodiment, the display panel 120 functions as a display unit for displaying the object.

The touch panel 130 is superimposed on the display panel 120, detects a user's contact operation, generates a detection signal, and transmits the detection signal to the calculation unit 150. The calculation unit 150 executes control according to the detection signal received from the touch panel 130. For example, when a swipe operation is detected on the displayed object, the object is moved in the swipe direction. The speaker 140 converts the audio signal received from the arithmetic unit 150 into an audible sound. As will be described in detail later, the speaker 140 functions as a reminder unit in cooperation with the calculation unit 150 when emitting a reminder voice for urging each user around the display table 100 to utter.

The object storage unit 170 is, for example, a storage device composed of an HDD, and stores object data of an object to be displayed on the display panel 120. The object storage unit 170 supplies object data to the calculation unit 150 in response to a request from the calculation unit 150. Further, when the object data is modified or edited by the user while the object data is displayed as an object on the display panel 120, the object storage unit 170 stores the object data updated by the modification or editing.

The memory 180 is a non-volatile storage medium, and for example, a solid state drive is used. The memory 240 stores various parameter values, functions, look-up tables, etc. used for control in addition to the control program for controlling the display system. The communication unit 190 includes, for example, a network connection unit which is a wireless LAN unit. The calculation unit 150 can exchange various data with and from an external device connected to the Internet 300 via the communication unit 190. Further, the communication unit 190 may include, for example, a short-range communication unit which is Bluetooth (registered trademark). When it has a short-range communication unit, it can directly exchange data with an external device arranged around it.

The calculation unit 150 is, for example, a CPU and controls the entire display system. The arithmetic unit 150 also plays a role as a functional processing unit that executes various operations related to control and processing. The calculation unit 151 and the control unit 152 are examples of functional processing units. The calculation unit 151 executes a calculation process for calculating the number of users around the display panel 120 and their respective positions based on the difference in the arrival time of the voice collected by the microphone 110. The control unit 152 adjusts the display position and orientation of the object to be displayed based on the number and position of users calculated by the calculation unit 151 to generate a video signal, and executes a display control process for displaying on the display panel 120. To do.

The display table 100 is connected to the Internet 300 via the communication unit 250. A voice analysis device 310 and an object storage device 320 as devices constituting the display system are connected to the Internet 300 together with the display table 100.

The voice analysis device 310 is configured by, for example, a server, converts voice data received from the display table 100 into text, performs word analysis, and identifies the content of the voice data using a DNN model or a logistic regression model. Then, the processing unit 150 extracts the processing that can be processed from the identified contents, converts it into a processing command, and sends it back to the display table 100. That is, when the arithmetic unit 150 identifies the content of the voice collected by the microphone 110 and sends the voice data to the voice analysis device 310, the calculation unit 150 can receive a processing command from the voice analysis device 310. Through such a series of processes, when the user utters a desired process for displaying the object, the display position, orientation, and size of the object can be changed according to the utterance content. Since such language processing is a process with a relatively large load, it is preferable to execute it in a dedicated external device.

The object storage device 320 is a storage device composed of, for example, an HDD, and stores object data of an object to be displayed on the display panel 120, similarly to the object storage unit 170. The object storage device 320 supplies object data to the calculation unit 150 in response to a request from the calculation unit 150. For example, if a user stores an electronic file created by a personal computer (not shown) in the object storage device 320 via the Internet 300, the user can display the expanded material of the electronic file on the display panel 120. Further, since the object storage device 320 can be accessed not only from the specific display table 100 but also from other display tables, it is suitable for storing objects that are generally used in a plurality of display tables. The display system may be configured such that the functions for storing objects are integrated in one of the object storage unit 170 and the object storage device 320, and the other is not provided.

Next, how such a display system displays an object on the display panel 120 will be described. FIG. 3 is a diagram showing the relationship between the user and the object display, and shows a state in which the display table 100 is viewed from above. As shown in the figure, in this embodiment, almost the entire area of the circular top plate is the display surface of the display panel 120, and three microphones 110a, 110b, and 110c are arranged around the display panel 120 at equal intervals of 120 °. There is. There is a space around the display table 100 in which a plurality of users can be seated. In the illustrated example, three users, user A, user B, and user C, are seated so as to surround the display panel 120.

On the display surface of the display panel 120, the coordinates at the center thereof are defined as (x, y) = (0,0), the right direction of the figure is defined as the x-axis, and the upward direction is defined as the y-axis. Further, the z-axis is defined as the front direction with respect to the figure. The coordinates of the microphones 110a, 110b, and 110c are known, and if the time difference in the time when the voice emitted by a user P reaches each microphone is measured with the speed of sound as a constant value, the third order of the mouth of the user P is measured. The original coordinates (x _p , y _p , z _p ) can be calculated. The calculation unit 151 identifies the time difference by shifting the voice waveforms collected by the three microphones 110a, 110b, and 110c in the time axis direction and executing the matching process. At this time, when a plurality of users utter at the same time, the calculation unit 151 may perform the matching process after separating the voice waveforms for each user by using the frequency information. In this embodiment, since it is desired to know in which direction the user exists with respect to the display panel 120, the calculated z-coordinate is not used, and the position of the user P is (x _p , y _p ). ..

Calculation unit 151 in this manner, the position of the user A from the user utterances _{A (x a, y a)} , the position of the user B from the user utterances _{B (x b, y b)} , the user C from the user utterances C The position of (x _c , y _c ) is calculated. The calculation unit 151 can count the number of users around the display panel 120 as a result by executing the position calculation for each user's utterance.

When the control unit 152 receives the position coordinates of each user from the calculation unit 151, the control unit 152 adjusts the display position and orientation so as to correspond to the position coordinates of the object to be displayed, and displays the object on the display panel 120. Specifically, as shown in the figure, the position and orientation of the object 801a for the user A, the object 801b for the user B, and the object 801c for the user C so as to face each user in front of each user. Adjust and display. The objects 801a, 801b, and 801c are objects having the same contents. The display position for each user is determined according to conditions such as the size and resolution of the object, the distance from the display panel 120 to the user, and the like. The display positions that are comfortable according to these conditions are verified in advance through experiments, for example, and are made into a look-up table. The control unit 152 can determine the display position with reference to such a look-up table.

According to this embodiment, each user can easily grasp the contents of the object because the object is displayed at the optimum position for himself / herself. In addition, since objects with the same content are displayed in front of each user, information can be shared quickly among the users present. For example, if the object to be displayed is an A4 vertical document, the control unit 152 displays the object to each user in the vertical direction with an A4 size of 100%. When a change in position, size, or orientation is instructed by the touch panel 130 or a voice instruction, the control unit 152 performs shift processing, scaling processing, and rotation processing in response to the instruction.

Note that the calculation unit 151 cannot calculate the position of the user unless the user's utterance is collected by the microphones 110a, 110b, 110c, and cannot grasp the existence of the user in the first place. Therefore, for example, when the display table 100 is activated, the calculation unit 150 can emit a reminder voice urging each user around the display table 100 to utter from the speaker 140 as an initial operation. For example, ask a few simple quizzes, such as "I will give you a quiz one by one, so please answer in order." The microphones 110a, 110b, 110c acquire the response to them as the voice of each user. The reminder voice is not limited to the case where it is emitted as a part of the initial operation, and may be emitted, for example, when a discrepancy is detected between the position of the recognizing user and the contact position of the touch panel 130.

FIG. 4 is a diagram showing a change in the object display when a part of the users move from the state shown in FIG. Similar to FIG. 3, the display table 100 is shown looking down from above.

When the display table 100 is activated, the microphones 110a, 110b, and 110c continuously collect sound, and the calculation unit 151 periodically calculates the number and position of users using the audio signal from the microphone. For example, since the user B also changes its utterance position when moved in the arrow direction by such shifting chairs, calculation unit 151 recalculates the position of the user B as the _{(x 'b, y' b} ). When the position of the user B is recalculated, the control unit 152 readjusts the display position and the orientation of the object 801b. If the amount of change in the user's position (for example, the distance from the position before the change to the position after the change) is less than the reference amount, readjust the display position and orientation to prevent the object from shaking slightly. It is preferable not to do so.

FIG. 5 is a diagram showing a change in the object display when a part of the users move out from the state shown in FIG. Similar to FIG. 4, the display table 100 is shown looking down from above.

If the calculation unit 151 periodically calculates the number and position of users as described above, the existence of the user, which has been confirmed up to that point, may not be confirmed from a certain point in time. In such a case, the control unit 152 deletes the corresponding object by determining that the user has moved out. For example, when the position of the user A cannot be confirmed as shown in the figure, the object 801a that has been displayed to the user A up to that point is deleted. Even if the user continues to exist, if the utterance is interrupted, the calculation unit 151 cannot calculate the position of the user. Therefore, if the calculation unit 151 cannot calculate the position of the target user even once within a certain period of time (for example, 15 minutes), the control unit 152 determines that the user has moved out and deletes the target object. Then it is good. In this case, the calculation unit 150 may emit a reminder voice from the speaker 140 to the target user before a certain period of time elapses. When the uttered voice is emitted from the speaker 140, it is preferable to emit the spoken voice at a timing when another user is not uttering.

It is also possible that another user will be added from a certain point in time. When the existence of the user is confirmed from the time when the calculation unit 151 is in a position that could not be confirmed so far, the control unit 152 adjusts the display position and orientation of a new object according to the position of the user. indicate. In this way, in order to adjust the object display according to the increase or decrease of the user, the calculation unit 151 continuously monitors the position of the user whose existence has been confirmed and records it as trajectory information. Is preferable. By recording the locus information, the control unit 152 can determine, for example, whether the target user has moved or newly appeared.

FIG. 6 is a diagram showing an example of a change in the object display when a voice instruction is recognized in the state of FIG. Similar to FIG. 3, the display table 100 is shown looking down from above.

The calculation unit 150 continuously transfers the voice signals from the microphones 110a, 110b, and 110c to the voice analysis device 310, and the voice analysis device 310 converts them into processing commands when an instruction regarding processing is extracted from the signals. It is sent back to the calculation unit 150. For example, when the user A instructs to "enlarge the display to double the size", the calculation unit 150 receives a processing command from the voice analysis device 310 to double the size of the object. According to the processing command, the control unit 152 adjusts and displays the object 802a, which is a double-enlarged object 801a that has been displayed so far, in a position and orientation that is easy for the user A to see. It should be noted that the fact that the person who utters "enlarged display to double the size" is the user A is confirmed by comparing the utterance position calculated by the calculation unit 151 with the position of the user A up to that point. ..

When the control unit 152 determines that the object 802a and the other objects displayed up to that point overlap with each other when the object 802a is displayed in the adjusted position and orientation, the control unit 152 deletes the other objects displayed up to that point. To do. In this way, by giving priority to the display of the object adjusted by the voice instruction, it is possible to realize the object display according to the user's intention.

Next, the processing flow of the display system according to the first embodiment will be described. FIG. 7 is a flow chart showing the processing flow. The illustrated flow describes the process of adjusting the display of the object according to the users around the display table 100, and does not cover all the processes related to the display. The flow of the figure starts from the time when the display table 100 is started.

The microphone 110 starts acquiring voice in step S101. The acquired voice is converted into a voice signal and handed over to the calculation unit 151 and the voice analysis device 310. At the time of initial operation, the calculation unit 150 may emit a reminder voice from the speaker 140.

In step S102, the calculation unit 151 calculates the number and positions of users around the display table 100 using the audio signal received from the microphone 110. In response to the calculation result, the control unit 152 arranges the display position and orientation of each object and displays them on the display panel 120 in step S103 so that each user can easily see them. If the position of a certain user calculated by the calculation unit 151 in step S102 is near the position calculated last time, the control unit 152 skips the display adjustment of the object for the user in step S103.

Proceeding to step S104, the calculation unit 150 confirms whether or not the user has instructed to change the display. Specifically, it is confirmed whether or not a processing command has been sent from the voice analysis device 310 to the voice signal sent to the voice analysis device 310 in step S101. Alternatively, it is confirmed whether or not the touch panel 130 has been operated. If a processing command has been sent or the touch panel 130 has been operated, the process proceeds to step S105. If the processing command has not been sent or the touch panel 130 has not been operated, step S105 is skipped and the process proceeds to step S106. When the process proceeds to step S105, the control unit 152 adjusts the display position, orientation, size, etc. of the object according to the processing command or the operation of the touch panel 130, and updates the display on the display panel 120. When the update of the display is completed, the process proceeds to step S106.

In step S106, the calculation unit 150 confirms whether or not the instruction to end the display has been received. If not accepted, the process returns to step S101. If it is accepted, the end process is executed to end the series of processes.

Next, the second embodiment will be described. Since the display system according to the second embodiment is the same as the configuration of the display system according to the first embodiment, the description of the overall configuration will be omitted. In the second embodiment, how to display the object when the number of users increases will be specifically mentioned. The display mode of the second embodiment may be implemented in addition to the display mode of the first embodiment or by changing a part of the display mode of the first embodiment.

FIG. 8 is a diagram showing the relationship between the user and the object display according to the second embodiment, and shows a state in which the display table 100 is looked down from above in the same manner as in FIG. In the example shown in FIG. 8, the user D is further added as compared with the example of FIG. User D is located between User A and User B, and it can be said that these three are seated in a relatively packed state.

Even in such a situation, if the objects to be displayed are relatively small with respect to the display panel 120, the control unit 152 makes each object 100% larger in front of each user, as in the display mode of FIG. Can be displayed properly with. In the example of FIG. 8, the control unit 152 vertically displays the object 801d, which is an A4 vertical document, in front of the user D in a size of 100% like other users.

However, when the objects to be displayed become large, when the users are seated in a relatively packed state, the objects cannot be displayed in front of each user without overlapping each other. FIG. 9 is a diagram showing the relationship between the user and the object display when the object to be displayed is large. The seating positions of users A to D are the same as in the example of FIG. 8, but the display target is changed from the object of the A4 vertical document to the object of the A3 horizontal document.

As shown in the figure, when trying to display the objects of the document next to A3 in 100% size in front of each user, the objects 803a and 803d shown by the dotted lines, and the objects 803d and 803b are shown with each other. It overlaps. Therefore, when the objects overlap each other, the control unit 152 recognizes the user for the overlapping plurality of objects as one group, replaces the overlapping objects with one, and one position and direction corresponding to the reference position of the group. Display the object of.

Specifically, since the objects 803a, 803b, and 803c overlap, the control unit 152 recognizes the users A, B, and D who are users for these objects as the same group. Since the position coordinates of the users A, B, and D are calculated by the calculation unit 151, the reference position of the group is calculated based on these coordinates. The reference position of the group is defined in advance. For example, the position coordinates of each user are converted into polar coordinates, and the position with respect to the distance and the declination that becomes the average value of these is defined as the reference position (x _s , y _s ). The control unit 152 displays the object 803s so that the display position and the orientation are optimal with respect to the reference position calculated in this way. By displaying the object 803s in this way, it is possible to secure a certain degree of visibility for each user in the same group. Further, in the example of the figure, it can be expected that the user A and the user B approach the user D and see the object 803s.

FIG. 10 is a diagram showing another example of the user and the object display when the object to be displayed is large. In the example of FIG. 9, one object is displayed in a size of 100% for a plurality of users who are recognized as the same group, but a space is created by not displaying the overlapping objects. Therefore, in the example of FIG. 10, the control unit 152 uses this surplus space to enlarge the object to be displayed. Specifically, with respect to the object 803s of FIG. 9, the object 804s enlarged with the same orientation is displayed by adjusting the position so that the entire object is displayed.

The enlargement ratio is determined in consideration of not overlapping the surplus space and the object (also object 803c) of another user (user C in the example of the figure) that does not belong to the same group. If the enlarged object 804s is displayed as shown in the figure, the visibility is improved as compared with the object 803s of FIG. The content of the object 804s is the same as that of the object 803c displayed at the same time.

The display mode of FIG. 10 is not limited to the case where an object overlaps with an adjacent object when an attempt is made to display the object at 100% size. For example, when an object of an A4 vertical document is displayed in a size of 100% in the aspect of FIG. 8, when a user gives an instruction for enlargement display, an adjacent object is displayed at the enlargement ratio. The display mode of FIG. 10 can be adopted even when they overlap with each other.

In the state of FIG. 8, for example, when the user A gives an instruction to enlarge the object 801a to 200% by a voice instruction or a touch panel operation instruction, if the object 801a is enlarged as it is, it overlaps with the adjacent object 801d. It ends up. Therefore, the control unit 152 first erases the objects 801a and 801d, recognizes the user A and the user D as the same group, calculates the reference position, and displays the object enlarged to 200% according to the reference position. .. That is, when the control unit 152 receives an instruction to enlarge an object from the user and the enlarged object overlaps with an adjacent object, the control unit 152 displays one enlarged object.

Next, the processing flow of the display system according to the second embodiment will be described. FIG. 11 is a flow chart showing the processing flow. Similar to the flow of FIG. 7, the illustrated flow describes a process of adjusting the display of the object according to the users around the display table 100, and does not cover all the processes related to the display. Further, the same processing as the flow of FIG. 7 is given the same step number, and the description thereof will be omitted unless otherwise specified.

In step S101, the microphone 110 starts acquiring voice, and in step S102, the calculation unit 151 calculates the number and positions of users around the display table 100, and then proceeds to step S203. In step S203, the control unit 152 arranges the display position and orientation of each object so that each user can easily see them, and attempts to display on the display panel 120. Specifically, if it is the initial setting, it tries to display each object at 100% size. If you have already received a size instruction or the settings have been changed, try to display each object in that size. Proceeding to step S204, the control unit 152 determines whether or not there are any overlapping objects as a result of adjusting the arrangement of the objects, and if it is determined that they do not overlap, the process proceeds to step S205, and when they overlap. If it is determined, the process proceeds to step S206.

When the process proceeds to step S205, as shown in FIG. 8, the control unit 152 adjusts the display position and orientation of each object and displays them on the display panel 120 so that the objects can be comfortably viewed from each user's position. .. Then, the process proceeds to step S104.

When the process proceeds to step S206, the control unit 152 extracts objects that overlap each other with adjacent objects. Then, the users corresponding to each of these objects are determined as one user group. Further proceeding to step S207, the control unit 152 calculates a reference position from the position coordinates of each user belonging to the user group, and adjusts the display position and orientation according to the reference position as shown in FIG. One object is displayed on the display panel 120. At this stage, as shown in FIG. 10, the surplus space may be used for enlarged display. Then, the process proceeds to step S104.

When the calculation unit 150 confirms that the user has instructed the change in step S104, the process proceeds to step S213. In step S213, the display position and orientation of each object are adjusted according to the confirmed processing command or the operation of the touch panel 130, and an attempt is made to see if the objects can be displayed on the display panel 120.

Proceeding to step S214, the control unit 152 determines whether or not there are any overlapping objects as a result of adjusting the arrangement of the objects, and if it is determined that they do not overlap, proceeds to step S215 and when they overlap. If it is determined, the process proceeds to step S216.

When the process proceeds to step S215, the control unit 152 adjusts the display position and orientation of each object according to the change instruction from the user so that the object can be visually recognized comfortably from the position of each user, and displays the object on the display panel 120. indicate. Then, the process proceeds to step S106.

When the process proceeds to step S216, the control unit 152 extracts objects that overlap each other with adjacent objects. Then, the users corresponding to each of these objects are determined as one user group. Further proceeding to step S217, the control unit 152 calculates a reference position from the position coordinates of each user belonging to the user group, and adjusts the display position and orientation according to the reference position and the change instruction from the user. , Display the object on the display panel 120. Then, the process proceeds to step S106. In step S106, the calculation unit 150 determines the end instruction.

Next, a third embodiment will be described. The display system according to the third embodiment has a configuration in which some elements are added to the display system according to the first embodiment. In the third embodiment, the personal identification of the user is performed, and the result is reflected in the display adjustment of the object. The display mode of the third embodiment may be implemented in addition to the display mode of the first embodiment and the second embodiment, or by changing a part of the display mode of the first embodiment and the second embodiment.

FIG. 12 is a control block diagram of the display system according to the third embodiment. In contrast to the configuration of the display system according to the first embodiment shown in FIG. 2, in the display system according to the third embodiment, the calculation unit 150 also functions as the identification unit 153, and the memory 180 stores the reference list 181. The difference is that the user voiceprint storage device 330 is connected to the Internet 300, and the voice analysis device 310 includes the discrimination unit 311. Elements that exhibit the same function are given the same numbering as in FIG. 2, and the description thereof will be omitted. If elements that exhibit the same function have different functions, they will be described in detail later.

The memory 180 stores the reference list 181. The reference list is a list in which personal information of each of a plurality of users who use the display system is registered in advance. The contents of the list will be described later.

The user voiceprint storage device 330 is a storage device composed of, for example, an HDD, and stores sample voice data obtained by converting sample voices of a plurality of users who use the display system into data. The voice data is stored as a voiceprint file for each user, for example, as an mp3 file.

The discrimination unit 311 incorporated in the voice analysis device 310 compares the voice data received from the display table 100 with the voiceprint file read from the user voiceprint storage device 330. Then, it is determined which voiceprint file the voice of the received voice data matches with, and the determination result is returned to the display table 100.

The identification unit 153 collates the discrimination result received from the voice analysis device 310 via the Internet 300 with the reference list 181 read from the memory 180, and identifies the uttering person. In addition, the priority of the uttering person is determined according to the registered contents of the reference list.

FIG. 13 is an example of the reference list 181 to be referred to when adjusting the object display. The reference list describes the priorities, usernames, and voiceprint files that are associated with each other. As shown in the figure, for example, the user "Ichiro Suzuki" stores the sampled voice as a voiceprint file named "001.mp3" in the user voiceprint storage device 330, and the priority is "1". Can be read from the reference list 181.

When the identification unit 153 receives the voiceprint file name as the discrimination result from the discrimination unit 311 of the voice analysis device 310, it collates with the reference list 181 and identifies the user corresponding to the voiceprint file name as the utterance person. At the same time, the priority of the vocalizing person is also specified.

Since the position of the uttering person is calculated by the calculation unit 151 from the voice signal, the control unit 152 grasps the number of users around the display table 100, the position of each user, and the priority of each user. be able to.

FIG. 14 is a diagram showing the relationship between the user and the object display, and shows a state in which the display table 100 is looked down from above in the same manner as in FIG. 3 and the like. As shown in the figure, four users A to D are seated around the display table 100, and the user A and the user D are close to each other. In such a situation, if the object of the document next to A3 is displayed on the display panel 120 in 100% size in front of each user, the object 805a for user A and the object 805d for user D overlap each other. ..

When the objects overlap each other in this way, the control unit 152 adjusts the display position and orientation of the objects by giving priority to the user having a higher priority. Specifically, when it is grasped that the priority of the user A is the fifth place and the priority of the user D is grasped as the second place, the second place is higher, so that the control unit 152 has the control unit 152. The display of the object 805a is abbreviated, and the object 805d adjusted according to _{the position (x d} , y _{d) of the user D is displayed.} The control unit 152 displays the object 805b after confirming that the object 805b does not overlap with other objects even if the object 805b is displayed at the display position and orientation optimally adjusted for the user B. The same applies to the object 805c for the user C.

By registering the priority in advance in this way, the display system can adjust the display position and orientation of the object according to the user having a high priority, and is therefore suitable for use in a meeting in an organization, for example. is there. When the user joins or leaves in the middle, the control unit 152 readjusts the display of the object according to the change. For example, when a user with a high priority is added, the display of the object for that user is prioritized, and if there is an already displayed object that overlaps the object, it is deleted. When a user with a high priority leaves, the display of the object to that user is stopped, and if there is an object whose display has been omitted for that object, that object is displayed. When the user moves around the display table 100, the display / non-display of the object is similarly determined by the priority.

FIG. 15 is a diagram showing the relationship between the user and the object display when the object to be displayed is large, and like FIG. 14, shows a state in which the display table 100 is viewed from above. For example, when displaying a larger document such as a CAD drawing as an object, the objects to be displayed may overlap each other even if adjacent users do not exist very close to each other. As shown in the figure, even if the distance between the user A and the user B is slightly narrower than the distance between the user A and the user C and the user B and the user C, a part of the object 806a with respect to the user A and the user B A part of the object 806b with respect to the above overlaps. In such a situation, simply hiding the object for the user with the lower priority as in the example of FIG. 14 causes a great inconvenience for the user with the lower priority. That is, since the objects displayed to other users are far away or have different orientations, it is difficult for a user with a low priority to grasp the contents of the objects.

Therefore, in such a case, the object for the user having a low priority is not simply hidden, but is reduced and displayed so as not to overlap with the object for the user with a high priority. For example, as shown in the figure, when the priority of the user B is the first and the priority of the user A is the fifth, the control unit 152 preferentially displays the object 806b with respect to the higher user B. To do. Then, the object 806a'in which the object 806a for the user A is reduced until it does not overlap with the object 806b is displayed. If the object 806a'is displayed in this way, the user A can grasp the contents of the object, although the size is slightly smaller than the original size.

FIG. 16 is a diagram showing the relationship between the user and the object display when the object to be displayed is larger, and shows a state in which the display table 100 is looked down from above as in FIGS. 14 and 15. When displaying an object larger than the object shown in FIG. 15, or when an object that is originally small but is to be displayed larger as a result of an enlargement instruction, it is preferable to display the object alone. That is, when one object occupies most of the display surface of the display panel 120, even if a small object is displayed in the surplus space as in the example of FIG. 15, it is difficult for the user to grasp the contents. Display only one object.

In this case, the control unit 152 confirms the priority of all the surrounding users, adjusts the display position and orientation of the object with the position of the highest user as the reference position, and displays the object. In the example of the figure, the priority of user A is 5th, the priority of user B is 1st, and the priority of user C is 3rd, so that the position of user B, which is the highest, (x _b). , Y _b ) is used as a reference position to display the object 805d whose display position and orientation are adjusted. It can be said that such a display is not only easy to see for the highest user, but also easy for other users to check the contents of the object even if the orientation is not optimal.

Three examples of FIGS. 14 to 16 have been described for how to display objects using the priority, but which example is adopted depends on the size of the object to be displayed and between adjacent users. It can be determined based on the interval, the size and shape of the display panel 120, and the like. For example, if the distance between adjacent users is less than a predetermined distance, the example of FIG. 14 is followed, and if the distance is greater than or equal to the predetermined distance, the example of FIG. 15 is followed. Further, when the example of FIG. 15 is followed, if the reduced object becomes smaller than a predetermined size, the example of FIG. 16 may be followed. In either case, if the objects overlap when trying to display the objects for each user in the specified size, then the object for the higher priority user is better than the other objects. It should be displayed in a large size. In this case, other objects may be hidden.

In the three examples of FIGS. 14 to 16, the display of the object is adjusted based on the priority described in the reference list 181. However, the personal information described in the reference list 181 does not have to be the priority. , The control unit 152 may adjust the display of the object based on other personal information. Other personal information may be the title or position of the user according to the priority. Alternatively, a plurality of attribute items that can be applied to each user may be prepared, and it may be described whether or not the attribute items are applicable. In this case, for example, the higher the number of applicable users, the higher the priority is assigned.

Next, the processing flow of the display system according to the third embodiment will be described. FIG. 17 is a flow chart showing a typical processing flow of the display system according to the third embodiment. Similar to the flow of FIG. 7, the illustrated flow describes a process of adjusting the display of the object according to the users around the display table 100, and does not cover all the processes related to the display. Further, the same processing as the flow of FIG. 7 is given the same step number, and the description thereof will be omitted unless otherwise specified.

In step S101, the microphone 110 starts acquiring voice, and in step S102, the calculation unit 151 calculates the number and positions of users around the display table 100, and then proceeds to step S301. In step S301, the identification unit 153 receives the voiceprint file name as the discrimination result from the discrimination unit 311 of the voice analysis device 310. Then, by collating with the reference list 181 read from the memory 180, the user corresponding to the voiceprint file name is identified as the uttering person. Further, in step S302, the priority of the user is determined from the description information in the reference list 181. As described above, the priority of the user is set in advance when it is directly described for each user registered in the reference list 181 and when it is derived from the description of personal information. It is determined by the derivation condition.

Proceeding to step S303, the control unit 152 adjusts and displays the display position and orientation of the target object based on the number and position of users calculated by the calculation unit 151 and the priority determined by the identification unit 153. It is displayed on the panel 120. The specific display mode is as described above. Then, the process proceeds to step S104.

If the calculation unit 150 confirms that the user has instructed the change in step S104, the process proceeds to step S305. In step S305, the control unit 152 adjusts the display position and orientation of each object according to the confirmed processing command or the operation of the touch panel 130, and displays the objects on the display panel 120. In this case as well, it is determined in advance whether or not the objects overlap each other, and if it is determined that the objects overlap, the objects are readjusted according to the priority of the user. Then, the process proceeds to step S106. In step S106, the calculation unit 150 determines the end instruction.

Next, a fourth embodiment will be described. FIG. 18 is a control block diagram of the display system according to the fourth embodiment. Elements that exhibit the same functions as in the first embodiment are given the same numbering numbers as those in FIG. 2, and the description thereof will be omitted.

The display system according to the fourth embodiment has a configuration in which the camera 160 is added to the display system according to the first embodiment. In the first embodiment, the calculation unit 151 calculates the number of users around the display table 100 and their respective positions based on the difference in the arrival time of the sounds collected by the microphones 110a, 110b, and 110c. However, in the fourth embodiment, the calculation unit 151'calculates based on the image captured by the camera 160.

The camera 160 is a digital camera unit capable of capturing an image of the display table 100 and its surroundings, and transmits the captured image as image data to the calculation unit 151'. The calculation unit 151'analyzes the received image data by, for example, a face recognition technique, and calculates the number of users around the display table 100 and their respective positions. In the fourth embodiment, the microphones 110a, 110b, 110c are used to collect voice instructions from the user.

FIG. 19 is a diagram showing the relationship between the user and the object display, and shows a state in which the display table 100 is viewed from above as in FIG. As the camera 160, for example by using the stereo camera and distance image camera, position coordinates (x _{p, y p)} of the user, such as when using the microphone can be calculated, where using a single image of the two-dimensional simple A method of calculating and using the user's orientation (θ _{p) will be described.} As shown in the figure, the orientation (θ) is represented by an angle from the positive direction of the x-axis when the z-axis is the rotation axis.

The camera 160 is a 360 ° camera installed upward at the origin position. Specifically, it is a camera unit including a fisheye lens having an angle of view of about 180 °. The calculation unit 151'recognizes the user A from the image captured by the camera 160 and calculates _{the direction θ a of the user A.} Similarly, the user B is recognized and the direction θ _{b of the} user B is calculated, and the user C is recognized and the direction θ _{c of the} user C is calculated. The calculation unit 151'can also count the number of users around the display table 100 as a result by executing the orientation calculation of each user.

When the control unit 152 receives the orientation of each user from the calculation unit 151', the control unit 152 adjusts the display position and orientation of the object to be displayed so as to correspond to the orientation, and displays the object on the display panel 120. Specifically, as shown in the figure, the position and orientation of the object 801a for the user A, the object 801b for the user B, and the object 801c for the user C so as to face each user in front of each user. Adjust and display. When displaying each object based on the orientation of the user, since it is not known how far the user is from the display table 100, for example, the distance from the peripheral edge of the display panel 120 to the edge of the object is a predetermined distance. Adjust the display position of the object so that.

Since each user will display the object in a position that is good for him / her, he / she can easily grasp the contents. In addition, since objects with the same content are displayed in front of each user, information can be shared quickly among the users present. For example, if the object to be displayed is an A4 vertical document, the control unit 152'displays the object to each user in the vertical direction with an A4 size of 100%. When a change in position, size, or orientation is instructed by the touch panel 130 or a voice instruction, the control unit 152'performs shift processing, scaling processing, and rotation processing according to the instruction.

Not limited to the case where the camera unit provided with the fisheye lens is provided at the center of the display panel 120, the camera 160 can adopt various camera units and can be arranged in various ways. For example, the stereo camera may be installed on the ceiling so as to overlook the display table 100. In that case, the calculation unit 151'can calculate the position coordinates of each user. Of course, the number of camera units does not have to be one, and a plurality of camera units may be used. When a plurality of units are used, it is sufficient that the display table 100 and its surroundings can be imaged as a whole.

In particular, if the camera 160 can also image the display area of the display panel 120, the control unit 152 may adjust the display of the object according to the state of the display area. For example, the calculation unit 151'extracts the display area of the display panel 120 from the image captured by the camera 160, divides it into a mesh shape, and calculates the illuminance of each mesh area. When the control unit 152 displays the object in the mesh region where the calculated illuminance is equal to or more than the first threshold value and less than the second threshold value, the control unit 152 increases the display brightness of the object. As a method of increasing the display brightness of an object, it is conceivable to increase the amount of light from the backlight or increase the brightness of the object. Further, when the calculated illuminance is equal to or higher than the second threshold value, the control unit 152 gives up displaying the object in the mesh area and displays it at another display position. The display system may employ either a process of increasing the display luminance or a process of displaying at another display position, or may adopt either one.

Further, even in the display system using the camera 160 in this way, as in the first embodiment, when an existing user moves, moves out, or a new user joins, the display system responds to changes. You can adjust the display position and orientation of the object. Further, as in the second embodiment, the same group can be recognized and the display position, orientation, and size of the object can be adjusted.

Further, if the method of identifying the individual by the image is adopted instead of the method of identifying the individual by the voice, the display of the object can be adjusted based on the personal information as in the third embodiment. Specifically, a user image storage device is provided instead of the user voiceprint storage device 330, and the face image of each user is stored in advance. Then, an image analysis device is provided instead of the voice analysis device 310, and the face image sent from the display table 100 is matched with the face image stored in the user image storage device, and the sent face image is eventually obtained. Is returned to the identification unit 153 as an analysis result as to whether or not the user is the user. The control unit 152 determines the priority of the recognized user, and executes display adjustment according to the priority.

Next, the processing flow of the display system according to the fourth embodiment will be described. FIG. 20 is a flow chart showing a typical processing flow of the display system according to the fourth embodiment. Similar to the flow of FIG. 7, the illustrated flow describes a process of adjusting the display of the object according to the users around the display table 100, and does not cover all the processes related to the display. Further, the same processing as the flow of FIG. 7 is given the same step number, and the description thereof will be omitted unless otherwise specified.

The camera 160 executes imaging in step S401. The image data generated by the imaging is handed over to the calculation unit 151'. In step S402, the calculation unit 151'recognizes each user from the image of the acquired image data and calculates each direction. In step S403, the control unit 152 adjusts the display position and orientation of the corresponding objects according to the orientation of each user calculated by the calculation unit 151'and displays them on the display panel 120. When calculating the illuminance of the display area of the display panel 120, adjustment may be performed according to the illuminance as described above. Subsequent processes from step S104 to step S106 are the same as in the example of FIG. 7.

Next, a fifth embodiment will be described. Since the display system according to the fifth embodiment is the same as the configuration of the display system according to the first embodiment, the description of the overall configuration will be omitted. In the fifth embodiment, when adjusting the display position and orientation of the object based on the position of each user, the object is distorted based on the estimated height of the user's eyes.

FIG. 21 is a diagram showing the state of the display table 100 and the user according to the fifth embodiment, and shows the state of observing the display table 100 from the side. As described above, if the time difference in the time when the voice emitted by a user P reaches the microphones 110a, 110b, 110c is measured, the three-dimensional coordinates (x _p , y _p , z _p ) of the mouth of the user P can be obtained. Can be calculated. Further, when the length of a standard eye and mouth of a person's face is h, binocular center position of the user _{P (x p, y p,} z 'p) is approximately _{(x p, y p, z} p + h )It is estimated to be. Therefore, in the present embodiment, the estimated height of the eye and z _'p. In the illustrated example, the estimated height of the eyes of the sitting user A 'is _a, estimated height of the eyes of the user C who is standing in z' z is _c.

FIG. 22 is a diagram for explaining the distortion processing of the object, and shows a state in which the display table 100 is observed from the side as in FIG. 21. Here, the object 808c displayed to the standing user C will be described.

Binocular center position of the user _{C (x c, y c,} z 'c) When it is estimated by the calculation unit 151, first, _(x c, _{y c)} from the position coordinates of the reference position is determined. The reference position is the position closest to the user when the object is displayed in a size of 100% in the example of FIG. Then, the object of 100% size is virtually rotated and lifted around the reference position until it is orthogonal to the line of sight of the user C. The line-of-sight direction of user C is the center position of the lifted object. The posture of the object at this time is indicated by the object 808c'.

Then, such a 100% assumed in posture size 'and the display surface of the display panel 120, both eyes center position of the user _{C (x c, y c,} z' object 808c of _c) as a point source Project. The object formed by such projection is the object 808c to be displayed. For example, the length of the longitudinal objects, from L ₁ by such projection, extending L 1 _'.

FIG. 23 is a diagram showing the relationship between the user and the object display, and shows a state in which the display table 100 displaying the distorted object in FIG. 22 is viewed from above. As illustrated, the object 808c that are displayed to the user C, compared the length of the vertical when it is displayed in 100% as indicated by a dotted line in the range of L _1, the L _{1 'by} distortion processing You can see how it is stretched. It is similarly extended in the lateral direction, and as a result, the object 808c has an inverted trapezoidal shape that expands toward the back side rather than the front side with respect to the user. The text and image shown as the information of the object 808c are similarly distorted. Further, the object 808a for the user A is similarly distorted according to the estimated height of the eyes of the seated user A.

By displaying the object with distortion processing in this way, the user can visually recognize the object in a state close to the original shape as a result, so that the content of the object can be grasped naturally without feeling any discomfort. Can be done. In particular, when the object contains characters, it is convenient because it is enlarged even if it is displayed far from the user.

It should be noted that various methods can be adopted for what kind of distortion processing is applied to the shape of the object according to the estimated height of the user's eyes. In the above example, the object is stretched into an inverted trapezoidal shape with priority given to making it easier for the user to understand the contents of the object, but when aiming for the effect of emphasizing the sense of depth when displaying an image, from the front side. The back side may be shrunk and distorted.

Further, also in this embodiment, as in the first embodiment, when an existing user moves, moves out, or a new user joins, the display position and orientation of the object are adjusted according to the change. can do. The adjustment in this case includes distortion processing according to the estimated height of the user's eyes. Also, when the user detects a change in standing or sitting, the control unit 152 readjusts the object to be dealt with. Further, as in the second embodiment, the control unit 152 can recognize the same group and adjust the display position, orientation, and size of the object. At this time, it is determined whether or not the adjacent objects overlap each other based on the distorted shape.

Further, also in this embodiment, as in the third embodiment, the identification unit 153 identifies the user, and the control unit 152 adjusts the display of the object based on the personal information of the user described in the reference list. You may. Further, the control unit 152 can use the personal information described in the reference list not only for determining the priority of the user but also for other display adjustments.

FIG. 24 is another example of the reference list to be referred to when adjusting the object display. The illustrated reference list 181'has more presbyopia registration items than the reference list 181 of FIG. For example, Ichiro Suzuki, who has the highest priority, has presbyopia registration "Yes", and Hanako Sato, who has the second highest priority, has "No" presbyopia registration. When such information is described in the reference list 181', the control unit 152 may, for a user with presbyopia registration, slightly move the display position of the object from the user position or increase the enlargement ratio. Can be adjusted.

In this embodiment, the processing related to sound can be replaced with the processing related to the image output by the camera as in the fourth embodiment. In that case, the system configuration described with reference to FIG. 18 may be adopted. When a camera is used, the height of the user's eyes can be directly analyzed, for example, by extracting the binocular region from the acquired image. When it is desired to calculate the center position of both eyes more accurately, a camera configuration such as a stereo camera that can acquire the distance information of the subject is preferable.

Next, the processing flow of the display system according to the fifth embodiment will be described. FIG. 25 is a flow chart showing the processing flow. Here, an example of executing personal identification and using the reference list 181'will be described. Similar to the flow of FIGS. 7 and 17, the illustrated flow describes a process of adjusting the display of the object according to the users around the display table 100, and covers all the processes related to the display. is not it. Further, the same processing as the flow of FIGS. 7 and 17 is assigned the same step number, and the description thereof will be omitted unless otherwise specified.

In step S101, the microphone 110 starts acquiring voice, and then in step S102, the calculation unit 151 calculates the number and positions of users around the display table 100. The calculation unit 151 calculates the binocular center position including the estimated height of the eyes as the user's position. Next, the process proceeds to step S301, and the identification unit 153 receives the determination result from the determination unit 311 and identifies the user by collating with the reference list 181'read from the memory 180. Further, in step S502, the priority and adjustment items of the user are determined from the description information of the reference list 181'. The adjustment items are, for example, the display position and the enlargement ratio for the presbyopia registration, and the display items to be adjusted are associated in advance according to the registered personal information.

In step S503, the control unit 152 distorts each object so that each user can easily see it, adjusts the display position and orientation, and displays the object on the display panel 120. The specific display mode is as described above. Then, the process proceeds to step S104.

If the calculation unit 150 confirms that the user has instructed the change in step S104, the process proceeds to step S505. In step S505, the control unit 152 distorts each object according to the confirmed processing command or the operation of the touch panel 130 to adjust the display position and orientation, and displays the object on the display panel 120. In this case as well, it is determined in advance whether or not the objects overlap each other, and if it is determined that the objects overlap, the objects are readjusted according to the priority of the user. Then, the process proceeds to step S106. In step S106, the calculation unit 150 determines the end instruction.

The present embodiment has been described through the above five examples and its modifications, but as described at the beginning, the display system according to the present embodiment has various modes other than those specifically described in each embodiment. Aspects can be adopted. For example, the display table 100 does not have to be circular, and may be rectangular or L-shaped, for example, depending on the application and environment in which the display system is used. Alternatively, the display unit may not be the display panel 120, but may have a configuration in which, for example, the upper surface of the display table is a projection surface and an image is projected from a projector provided on the ceiling. Further, the number of microphones dispersed around the display unit is not limited to three, and may be more than three. If more microphones are provided and their audio signals are used, more accurate calculation results can be obtained.

100 display table, 110 microphone, 120 display panel, 130 touch panel, 140 speaker, 150 arithmetic unit, 151 calculation unit, 152 control unit, 153 identification unit, 160 camera, 170 object storage unit, 180 memory, 181 reference list, 190 communication Unit, 300 Internet, 310 voice analyzer, 311 discriminator, 320 object storage device, 330 user voiceprint storage device

Claims (8)

A display unit that displays objects and
A calculation unit that calculates the number of users around the display unit and their respective positions based on the output signals of sensors arranged around the display unit.
An identification unit that personally identifies each user around the display unit,
A storage unit that stores a reference list in which personal information of multiple users is registered,
The display position and orientation of the object are adjusted and displayed on the display unit based on the result of comparing the number and position of users calculated by the calculation unit and the identification information identified by the identification unit with the reference list. A display system with a control unit. In the reference list, the priorities of the plurality of users are registered as the personal information.
The display system according to claim 1, wherein the control unit gives priority to a user having a higher priority and adjusts the display position and orientation of the object. 2. The control unit omits the display of the object to the user having a lower priority when the objects overlap each other when trying to display the object to each of the users around the display unit. The display system described in. The display system according to claim 2 or 3, wherein the control unit displays an object for a user having a higher priority than other objects. The display system according to claim 2, wherein when the object is enlarged and displayed by one, the control unit adjusts the display position and orientation of the object with reference to the user having the highest priority. The display system according to any one of claims 1 to 5, wherein the control unit readjusts the display position and orientation of the object when the calculation unit calculates that the position of the user has changed. The method according to any one of claims 1 to 6, wherein the control unit readjusts the display position and orientation of the object when the calculation unit calculates that the number of users has increased or decreased. Display system. It is a control method of a display system including a display unit for displaying an object and a storage unit for storing a reference list in which personal information of a plurality of users is registered.
A calculation step of calculating the number of users around the display unit and their respective positions based on the output signals of the sensors arranged around the display unit, and
An identification step that personally identifies each of the users around the display unit,
The display position and orientation of the object are adjusted and displayed on the display unit based on the result of comparing the number and position of users calculated in the calculation step and the identification information identified in the identification step with the reference list. A control method having a control step to be performed.

Images