JP7017699B2 - Information processing equipment, control methods, and programs - Google Patents

Description

The present invention relates to a technique for shooting in cooperation with a device provided with a shooting means.

Systems for communicating between remote locations have become widespread. For example, at a construction site, workers at the site communicate with operators at remote locations using information processing terminals such as smartphones and tablets. (For example, see Patent Document 1).

Japanese Unexamined Patent Publication No. 2018-36812

However, in a system as described in Patent Document 1, depending on the information processing device, the image quality of the image obtained by taking a picture may be rough and the visibility may be poor, and there is a problem that mutual communication is difficult. ..

In order to solve such problems, it is assumed that a camera capable of shooting with high accuracy is externally connected to the information processing terminal and the images obtained by shooting with the camera are captured, but online communication is possible. In such a case, when the moving image taken by the camera is exchanged between the camera and the information processing terminal, a communication load is applied between the two devices, which may hinder the cooperation of the image data.

Therefore, an object of the present invention is to provide a mechanism for linking image data obtained by shooting in cooperation with a device provided with a shooting means.

The present invention for achieving the above object is an information processing device that communicates with other devices, and obtains acquired information for acquiring image data taken by a device provided with an external photographing unit capable of communicating. It is provided with a storage means for storing and an acquisition means for acquiring image data taken by a device provided with the external photographing unit based on the acquired information when communication with the other device is completed. It is a feature.

According to the present invention, there is an effect that the image data obtained by shooting in cooperation with a device provided with a shooting means can be linked.

It is a block diagram which shows the schematic structure of an information processing system. It is a block diagram which shows the schematic structure of the hardware of a client terminal, a server, and an administrator terminal. It is a flowchart which shows the process at the time of login. It is a flowchart which shows the process which a user enters a room. It is a flowchart which shows the process of activating an external camera. It is a flowchart which shows the process of recording. It is a flowchart which shows the process of downloading the recording data. It is a flowchart which shows the process of uploading a recorded data. It is a block diagram which shows the structure of each table and the like. It is a block diagram which shows the structure of a login screen. It is a block diagram which shows the structure of a room list screen. It is a block diagram which shows the structure of a communication screen. It is a block diagram which shows the structure of the download screen and the upload screen.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

The information processing system 100 in FIG. 1 is an image obtained by taking a picture with a camera 102, which is a device provided with a shooting means, a client terminal 104, which is also an information processing device provided with a shooting means, a camera 102, and a client terminal 104. The server 106, which is an information processing device that receives and manages information (shooting information) related to shooting such as detected voice, displays shooting information managed by the server 106, and gives operation instructions to the camera 102 and client terminal 104 and the client terminal. It has a configuration including an administrator terminal 108 which is an information processing device capable of talking with 104.

Next, with reference to FIG. 2, an example of a hardware configuration applicable to the client terminal 104 according to the embodiment of the present invention will be described.

In FIG. 2, 201 is a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize the functions executed by the BIOS (Basic Input / Output System) and the operating system (hereinafter, OS), which are the control programs of the CPU 201, and each server or each PC. Various programs and the like described later are stored.

Reference numeral 203 denotes a RAM, which functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing a process from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

Further, 205 is an input controller, which controls the input from the input device 209. Examples of the input device 209 include a keyboard, a touch panel, a pointing device such as a mouse, and the like.

When the input device 209 is a touch panel, the user can give various instructions by pressing (touching with a finger or the like) the icon, the cursor, or the button displayed on the touch panel.

Further, the touch panel may be a touch panel such as a multi-touch screen that can detect a position touched by a plurality of fingers.

Reference numeral 206 denotes a video controller, which controls the display on a display such as the display 210. The display 210 refers to a display device such as a CRT or a liquid crystal display. Alternatively, it may be another display.

It should be noted that the display of the notebook personal computer integrated with the main body is also included. The external output device is not limited to the display, and may be, for example, a projector.

Further, when the device to which the hardware configuration of FIG. 2 is applied is a device capable of accepting the above-mentioned touch operation, the display 210 provides a function as an input device 209.

The 207 is a memory controller, which is connected to a hard disk (HDD) for storing boot programs, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA card slot via an adapter. It controls access to an external memory 211 such as a compact flash (registered trademark) memory.

Reference numeral 208 denotes a communication I / F controller, which connects and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

The CPU 201 enables display on the display 210 by, for example, executing an outline font expansion (rasterization) process in the display information area in the RAM 203. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the display 210.

Various programs described later for realizing the present invention are recorded in the ROM 202 or the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as needed.

Further, definition files, various information, tables, etc. used when executing the above program are also stored in the external memory 211, and detailed explanations thereof will be described later.

The camera controller 212 controls video acquisition by the camera 214 or the like, and the audio controller 213 controls audio acquisition control by the microphone / speaker 215 or the like and output to the speaker.

The camera 214 is a camera built in the device to which the hardware configuration of FIG. 2 is applied. Further, the microphone / speaker 215 is a microphone and a speaker built in the device to which the hardware configuration of FIG. 2 is applied. The above is the explanation of FIG.

Since the server 106 and the administrator terminal 108 have almost the same configuration as the client terminal 104, the description thereof will be omitted.

Next, the process when the client terminal 104 logs in to the information processing system 100 will be described using the flowchart shown in FIG. The processing in each step is executed under the control of the CPU in each device.

In step S100, the client terminal 104 displays the login screen 400 (see FIG. 10), and when it is detected that the login button 401 of the login screen 400 is pressed, it is input to the user name 402 and password 403 of the login screen 400. Obtain login information including the user name and password.

In step S102, the client terminal 104 transmits the login information acquired in step S100 to the server 106.

In step S104, the server 106 receives the login information transmitted from the client terminal 104 in step S102.

In step S106, the server 106 confirms whether or not the login information received in step S104 exists in the user authentication information table 300 (see FIG. 9).

As shown in the upper part of FIG. 9, the user authentication information table 300 is configured to include information regarding a user name, a password, and authority for using the system.

In this step, it is confirmed whether or not the user name and password included in the login information match the user name and password in the user authentication information table.

In step S108, if the server 106 determines that the login information exists in the user authentication information table 300, it is assumed that the user can log in to the system, and the process proceeds to step S110. If it does not determine that the login information exists, the process proceeds to step S116. Proceed.

In step S110, if the server 106 can acquire the authority information corresponding to the user name and password of the user authentication information table 300 that matches the user name and password of the login information from the user authentication information table 300, the process proceeds to step S114. If it cannot be acquired, the process proceeds to step S116.

By having the authority information, it is possible to separately use the application that can be used by the user on the client terminal 104 and the application that can be used by the operator on the administrator terminal 108.

In step S114, the server 106 acquires the room list information from the room information table 302 (see FIG. 10).

As shown in the center of FIG. 10, the room information table 302 is connected to a room ID for uniquely identifying a room, a room name indicating the room name, the number of people entering the room, and an external camera. It is configured to include the availability of an external camera indicating whether or not it can be used, the allowable number of people indicating the maximum number of people who can enter the room, and the entering user indicating the user who has entered the room.

In step S116, the server 106 acquires error information indicating that the system cannot be used.

In step S118, the server 106 transmits the room list information acquired in step S114 or the error information acquired in step S116 to the client terminal 104 as login result information.

In step S120, the client terminal 104 receives the login result information transmitted from the server 106 in step S118.

In step S122, the client terminal 104 determines whether or not the login result information received in step S120 contains error information, and if it is determined to be included, proceeds to step S124 and does not determine that it is included. If so, the process proceeds to step S126.

In step S124, the client terminal 104 displays an error screen (not shown) indicating that the system cannot be used based on the error information.

In step S126, the client terminal 104 displays information about the room on the room list screen 500 (see FIG. 11) based on the information of the room list of the login result information.

The room list screen 500 shows the room name 501 indicating the name of the room, the number of people currently in the room 502, and whether the camera connected to the outside can be used in the room or only the camera built in the room can be used. It is provided with a configuration including a restriction 503 indicating a restriction on use and an entry button 504 for pressing when entering the room.

Next, the process of the user entering the room will be described using the flowchart shown in FIG. The processing in each step is executed under the control of the CPU in each device.

In step S200, the client terminal 104 acquires information (room ID, etc.) about the room in which the entry button 504 is pressed on the room list screen 500.

In step S202, the client terminal 104 acquires in step S200 and transmits information about the room to the server 106.

In step S204, the server 106 receives the information about the room transmitted from the client terminal 104 in step S202.

In step S206, the server 106 acquires a record in the room information table 302 corresponding to the information about the room received in step S204 (for example, the room IDs match).

In step S208, the server 106 increments the number of people entering the room of the record acquired in step S206 by one, determines whether or not the number of people is within the allowable number of people, and if it is determined that the number of people is within the allowable number of people. If it is not determined that the number of people is within the allowable number of people, the room is considered to be full and the process proceeds to step S212.

In step S210, the server 106 is set so as to be able to communicate with the terminal of the user participating in the room by allowing the user to enter the room. In addition, the user name is registered in the room entry user of the room information table.

In step S212, the server 106 acquires error information indicating that the room cannot be entered.

In step S214, the server 106 transmits the information indicating that the room entry is permitted in step 210 or the error information acquired in step S212 to the client terminal 104 as room entry result information.

In step S216, the client terminal 104 receives the room entry result information transmitted from the server 106 in step S214.

In step S218, the client terminal 104 determines whether or not the room entry result information received in step S216 is error information, and if it is determined to be error information, proceeds to step S232 to obtain error information. If not, the process proceeds to step S220.

In step S220, the client terminal 104 determines whether or not the built-in camera is set by default so that it can be used at startup. If it is not determined, the client terminal 104 proceeds to step S222 and is set. If it is not determined, the process proceeds to step S224.

In step S222, the client terminal 104 determines whether or not the room is restricted from activating the camera 102 connected so as to be able to communicate with the outside, based on the information displayed in the restriction 503. If it is determined that the room is restricted, the process proceeds to step S224, and if it is not determined that the room is restricted, the process proceeds to step S226.

In step S224, the client terminal 104 activates the built-in camera, and in step S226, the client terminal 104 activates the external camera 102 connected so as to be able to communicate (described later in FIG. 5).

As the external camera 102 that can be used in the room, one preset camera may be activated, or the external camera 102 may be displayed in a list on the screen (not shown) and selected. You may start it.

In step S228, the client terminal 104 determines whether or not an error notification has been made when the camera is activated. If it is not determined that the error notification has been made, the process proceeds to step S230, and if it is not determined that the error notification has been made, step S232. Proceed to process.

In step S230, the client terminal 104 displays the communication screen 600 (see FIG. 12) and starts communication with the administrator terminal 108 used by the operator.

FIG. 12 shows the configuration of the communication screen 600, and the communication screen 600 is an image data obtained by taking a picture with a built-in camera or an image obtained by taking a picture with an external camera 102. It has a configuration for displaying data.

In addition, information for identifying whether the image data is obtained by taking a picture with a built-in camera or the image data obtained by taking a picture with an external camera 102 may be displayed. ..

Alternatively, when displaying the image data obtained by shooting with the external camera 102, specific information that can identify the camera 102 that is shooting the image data displayed from some external cameras 102 is provided. You may display it.

Next, a process of activating the external camera 102 connected so as to be able to communicate will be described using the flowchart shown in FIG. Each step in this process is executed under the control of the CPU of the client terminal 104.

In step S300, information for communicating with the external camera 102 to be connected is acquired from a predefined setting file (not shown), and in step S302, the information acquired in step S400 is used as connection request information for connection. It is transmitted to the target camera 102.

In step S304, if it is determined that there is a response from the camera 102 that transmitted the connection request information in step S302, the process proceeds to step S306, and if it is not determined that there is a response (for example, a poor connection or a power supply to the external camera). If it is not included), the process proceeds to step S308.

In step S306, it is determined whether or not the camera 102 has been activated based on the response received from the camera 102 in step S304, and if it is determined that the camera 102 has been activated, the process proceeds to step S310 and it is determined that the process has failed. If so, the process proceeds to step S308.

In step S308, if there is no response even after the lapse of a predetermined time in step S304, or if the start-up fails in step S306, error information indicating that effect is notified, and in step S310, the start-up is notified as successful.

Next, the process of recording with the camera 102 will be described using the flowchart shown in FIG. Each step in this process is executed under the control of the CPU of the client terminal 104.

In step S400, when the recording button 606 of the communication screen 600 is pressed, a recording request packet for instructing the start of recording is created and transmitted to the camera 102.

When the shooting button 604 of the communication screen 600 is pressed, a shooting instruction is given to the camera 102, the shooting is performed by the camera 102, and a still image can be obtained.

In step S402, it is determined whether or not there is a response from the camera 102 to the recording request packet transmitted in step S400, and if there is a response, the process proceeds to step S404, and if there is no response, the process proceeds to step S408.

In step S404, it is determined whether the camera 102 has succeeded in starting recording, and if the recording is successful, the process proceeds to step S406, and if the recording is not successful, the process proceeds to step S408.

In step S406, a download ticket indicating that there is data recorded by the camera 102 is issued (see FIG. 9).

The lower part of FIG. 9 shows the configuration of the download ticket, and the download ticket is a ticket No. for uniquely identifying the download ticket, and image data obtained by recording with the camera 102 (hereinafter, recorded data). ), The file name indicating the file name (included in the response in step S402), the file path indicating the location where the recorded data in the camera 102 is stored (included in the response in step S402), and the room currently in the room. It is composed of the room name indicating the name and the time when the recording was performed.

In step S408, if there is no response because the connection is poor or the camera 102 is not turned on in step S402, or if the recording start fails in step S404, an error is notified.

Next, a process of downloading the recorded data stored in the camera 102 to the client terminal 104 will be described using the flowchart shown in FIG. 7. Each step in this process is executed under the control of the CPU of the client terminal 104.

In step S500, when the download screen 700 (see FIG. 13) is activated, the download ticket information in the client terminal 104 is acquired.

In step S502, as a result of acquiring the download ticket information in step S500, it is determined whether or not the download ticket exists. If it is determined that the download ticket exists, the process proceeds to step S504, and if it is not determined, this process is performed. finish.

In step S504, the download ticket information acquired in step S502 is displayed on the download screen 700 as a recording ticket.

The download screen 700 includes a No. for uniquely identifying the recording ticket, a file name indicating the file name of the recording data downloaded by the recording ticket, and the recording time of the recording data.

These items correspond to the download ticket No., the file name, and the recording time in the order described above.

In step S506, the storage location of the recording ticket selected from the recording tickets displayed on the download screen 700 is acquired from the file path of the download ticket.

At the time of acquisition, the No. of the download screen 700 is used as the primary key to search the No. of the download ticket to acquire the file path of the corresponding record. In step S508, information such as the file path and file name of the recorded data acquired in step S506 is obtained. Based on the above, a download request packet requesting the camera 102 to download the recorded data is created and transmitted.

In step S510, it is determined whether or not there is a response from the camera 102, and if there is a response, the process proceeds to step S512, and if it is not determined that there is a response, the process proceeds to step S526.

In step S512, the recorded data stored in the camera 102 is downloaded, and in step S514, when the download of the recorded data is completed, a download completion packet notifying the completion of the download is created and transmitted to the camera 102.

In step S516, it is determined whether or not there is a response from the camera 102 in response to the notification that the download is completed in step S512, and if it is determined that there is a response, the process proceeds to step S518 and it is not determined that there is a response. If so, the process proceeds to step S526.

In step S518, a recording data deletion request packet for requesting the camera 102 to delete the recorded data for which the download has been completed is created and transmitted.

In step S520, it is determined whether or not there is a response from the camera 102, and if it is determined that there is a response, the process proceeds to step S522, and if it is not determined that there is a response, the process proceeds to step S526.

In step S522, the download ticket for the downloaded recorded data is deleted, and in step S524, the completion of downloading the recorded data is notified.

In step S526, if there is no response due to a poor connection in step S510 or the camera 102 is not turned on, or if the download or recording data deletion in step S516 or step S520 fails, an error is notified.

Next, a process of uploading the recorded data downloaded to the client terminal 104 to the server 106 will be described using the flowchart shown in FIG. It is executed under the control of the CPU of the client terminal 104 or the server 106.

In step S600, when the upload screen 800 (see FIG. 13) is activated, the client terminal 104 acquires information about the downloaded recorded data in the client terminal 104 and displays it on the upload screen 800.

With respect to the recorded data selected from the list of recorded data displayed on the upload screen 800, a packet for uploading is created and transmitted to the server 106.

In step S602, the server 106 receives the recorded data upload packet transmitted in step S600.

The download screen 700 and the upload screen 800 are displayed by pressing the download screen display tab 702 and the upload screen display tab 802 provided respectively.

In step S604, the server 106 determines whether or not the reception of the recorded data was successful, and if it is determined to be successful, the process proceeds to step S608, and if it is not determined to be successful, the process is performed to step S606. Proceed.

In step S606, if the server 106 fails to upload the recorded data, the server 106 acquires information regarding the error.

In step S608, the server 106 creates a reply packet including the success or failure of uploading the recorded data and sends it to the client terminal 104.

In step S610, the client terminal 104 receives the reply packet transmitted from the server 106 in step S608.

In step S612, the client terminal 104 determines whether or not the upload of the recorded data is successful based on the reply packet received in step S610, and if it is determined that the upload is successful, the process proceeds to step S614. If it is not determined to be successful, the process proceeds to step S616.

In step S614, the client terminal 104 deletes the recorded data that has been successfully uploaded, and in step S616, the client terminal 104 notifies the error based on the information regarding the error.

In the administrator terminal 108, it is possible to refer to the recorded data uploaded to the server 106, and it is possible to browse clearer image data.

As described above, a recording medium recording a program that realizes the functions of the above-described embodiment is supplied to the system or device, and the computer (or CPU or MPU) of the system or device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disc or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually realized based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device.

It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium containing the program for achieving the present invention into the system or device, the system or device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention.

It should be noted that the present invention also includes all the configurations in which each of the above-described embodiments and modifications thereof are combined.

100 Information processing system 102 Camera 104 Client terminal 106 Server 108 Administrator terminal

Claims (3)

An information processing device that communicates with other devices.
A storage means for storing acquired information for acquiring image data taken by a device equipped with a communicable external photographing unit, and a storage means.
When the communication with the other device is completed, the acquisition means for acquiring the image data taken by the device provided with the external photographing unit based on the acquired information, and the acquisition means.
An information processing device characterized by being equipped with. It is a control method for information processing devices that communicate with other devices.
The information processing device is
A storage step for storing acquired information for acquiring image data taken by a device equipped with a communicable external photographing unit, and a storage step.
When the communication with the other device is completed, the acquisition step of acquiring the image data taken by the device provided with the external photographing unit based on the acquired information, and the acquisition step.
A method of controlling an information processing device, which is characterized by executing. A computer that communicates with other devices,
A storage means for storing acquired information for acquiring image data taken by a device equipped with a communicable external photographing unit, and a storage means.
When the communication with the other device is completed, the acquisition means for acquiring the image data taken by the device provided with the external photographing unit based on the acquired information, and the acquisition means.
A program to make it work.

Images