JP2018026713A - Information processing apparatus, information processing system, and control method and program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism that enables newly acquired images to be easily transmitted using functions already used for image transmission.MEANS FOR SOLVING THE PROBLEM: The information processing apparatus is configured to sequentially transmitting an image captured by an image capturing apparatus to be sequentially displayed on a plurality of information processing apparatuses, control to store a still image, determine whether the image is being transmitted by an image transmission function, and, when the image is being transmitted, the still image is controlled to be transmitted to the plurality of information processing apparatuses by the transmission function.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an information processing apparatus, an information processing system, a control method thereof, and a program.

  In recent years, web conferencing systems have become popular. In addition, a web conference system using a portable terminal is generally provided.

  For example, Patent Document 1 describes a technology for performing a web conference using a mobile terminal. According to Patent Literature 1, when a web conference is performed on a mobile terminal, an image is captured using, for example, a camera mounted on the mobile terminal itself or a camera separately installed and connected on the mobile terminal. To other devices participating in the conference.

Japanese Patent Laid-Open No. 2015-82207 JP 2013-027037 A

  For example, if you want to inform the users of other terminals participating in the conference about the situation of the outdoor site such as a construction site or event venue, for example, use the out-camera of the mobile terminal (camera installed on the back of the mobile terminal). It is conceivable to use the camera to image the scene and send it to other terminals. However, it is troublesome to perform the work while simultaneously capturing an image capturing operation and a conversation with another user participating in the conference. In addition, even if the conversation can be performed while taking an image, for example, if the user concentrates on the conversation and loses consciousness from the image capturing work, there is a high possibility that a camera shake or a focus shift will occur. The desired image may not be shared with other terminals.

  Patent Document 2 describes a technique for transmitting an image captured by a mobile terminal to an external device using a dedicated service, or by e-mail. It takes time and effort to launch other applications and services that are not, specify a desired destination, and transmit.

  An object of the present invention is to provide a mechanism that enables a newly acquired image to be easily transmitted using a function that has already been used for image transmission.

  An information processing apparatus according to the present invention is an information processing apparatus including an imaging device that can communicate with a plurality of information processing apparatuses including a display unit, and an image captured by the imaging device is transmitted to the plurality of information processing apparatuses. Transmission means for sequentially transmitting to display sequentially, still image storage control means for controlling to store still images, determination means for determining whether an image is transmitted by the transmission means, and transmission by the determination means Control means for controlling the transmission means to transmit the still images stored by the still image storage control means to the plurality of information processing devices when it is determined that the image is transmitted by the means; It is characterized by providing.

  According to the present invention, it is possible to provide a mechanism that allows a newly acquired image to be easily transmitted using a function already used for image transmission.

  For example, it is possible to provide a mechanism that allows a still image to be easily shared using a function of sequentially transmitting and sharing a moving image for a conference during the conference.

It is a figure which shows an example of a structure of the information processing system in embodiment of this invention. It is a figure which shows an example of the hardware constitutions of various apparatuses in embodiment of this invention. It is a figure which shows an example of a function structure of the various apparatuses in embodiment of this invention. It is a flowchart which shows the outline | summary of a process in the 1st Embodiment of this invention. It is a flowchart which shows the flow of the on / off switching process of the meeting image transmission function in the 1st Embodiment of this invention. It is a flowchart which shows the flow of the still image sharing process in the 1st Embodiment of this invention. It is a figure which shows an example of the various data structure in the 1st Embodiment of this invention. It is a figure which shows an example of a structure of the meeting screen in the 1st Embodiment of this invention, and the mode of a transition. It is a figure which shows an example of a structure of the display screen of the still image sharing process in the 2nd Embodiment of this invention. It is a figure which shows an example of the various data structure in the 2nd Embodiment of this invention. It is a figure which shows an example of a structure of the display screen of the still image sharing process in the 3rd Embodiment of this invention. It is a figure which shows an example of the various data structure in the 3rd Embodiment of this invention.

  Hereinafter, an example of an embodiment of the present invention will be described with reference to the drawings.

  First, an example of the configuration of an information processing system in the embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 1, the information processing system according to the present invention enables communication between the server 200 and the mobile terminal 100 (general name of the mobile terminal 100A, the mobile terminal 100B, the mobile terminal 100C, and the mobile terminal 100D) via the network 101. Connected and configured.

  The server 200 has various functions for executing a web conference using the mobile terminal 100. For example, creation and storage of a room for a web conference, identification information of the mobile terminal 100, and a conference image received from each mobile terminal (for example, a captured image (video) that is image data obtained by capturing a user who is a conference participant). Storage, storage of association information between the conference image and the terminal that transmitted the conference image, and control of transmission processing of the conference image to each form terminal are performed.

  The portable terminal 100 is a terminal having a camera function and a touch panel function (operation unit). The mobile terminal 100 is installed on the surface opposite to the in-camera (camera installed on the side where the display is installed) and the out-camera (back side of the mobile terminal / display side). Camera).

  Using the function of the conference application, the mobile terminal 100 logs in to the server 200 in response to an operation from the user, and the same image (conference image / video) captured by the camera is acquired via the server 200. Are sequentially transmitted to other mobile terminals 100 entering the room (participating in the conference).

  In addition to the image data acquired from the camera, data stored in the portable terminal 100, for example, static data such as photographic images and document data such as PDF files can be transferred to other portable devices via the server 200. A file sharing function for transmitting and sharing to the terminal 100 is provided.

  The conference application also has an application image sharing function for transmitting and sharing an image of an application screen other than the conference application running on the mobile terminal 100 to another mobile terminal. The above is the description of an example of the configuration of the information processing system in the embodiment of the present invention shown in FIG.

  Next, an example of the hardware configuration of various devices in the embodiment of the present invention will be described with reference to FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 202 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs to be described later are stored.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display device such as a CRT display (CRT) 210. In FIG. 2, although described as CRT 210, the display device is not limited to the CRT, but may be another display device such as a liquid crystal display. These are used by the administrator as needed.

  In the embodiment of the present invention, the CRT 210 of the mobile terminal 100 has a touch panel function. When the CRT 210 has a touch panel function, the CRT 210 also functions as an input device, and the touch operation information detected by the touch panel function (received by the display) is transmitted to the input controller as input information. That is, the input controller 205 performs input control from the CRT 210.

  A memory controller 207 is connected to the hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, etc. via an adapter. The access to the external memory 211 such as a compact flash (registered trademark) memory is controlled.

  A communication I / F controller 208 connects and communicates with an external device via a network (for example, the network 101 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

  Reference numeral 212 denotes an acceleration sensor, which detects the acceleration of the mobile terminal 100, for example. When the acceleration sensor is attached to an apparatus such as the portable terminal 100 as an external apparatus, for example, the acceleration sensor 212 communicates acceleration information detected by communicating with the input controller 205 to the portable terminal 100. The acceleration information is accumulated and stored as a history of the operation of the mobile terminal on the RAM 203, for example. The above is an explanation of an example of the hardware configuration of various apparatuses in the embodiment of the present invention shown in FIG.

  Next, with reference to FIG. 3, an example of a functional configuration of various apparatuses in the embodiment of the present invention will be described. FIG. 3 is a diagram illustrating an example of a functional configuration of various apparatuses according to the embodiment of the present invention.

  Each of the functional units 311 to 319 in FIG. 3 is a functional unit included in a web conference application (client application) installed in the mobile terminal 100. Each functional unit 322 to 323 is a functional unit included in a web conference application (server application) installed in the server 200.

  The captured image storage control unit 311 is a conference image of the own device that is an image to be transmitted to the other terminals participating in the conference (for example, the mobile terminals 100B to 100D for the mobile terminal 100A). As a control unit that performs control to be stored in the external memory.

  The conference image transmission unit 312 transmits the conference image of the host device stored in the host device to the server 200 (sends to other terminals participating in the same conference as the host device via the server 200). It is. When an unsent conference image is transmitted, information indicating that it has been transmitted is stored in association with the conference image, so that the transmitted conference image and the unsent conference image are managed separately.

  The transmission function valid / invalid determination unit 313 is a determination unit that determines whether the conference image transmission unit 312 is functioning (whether the conference image transmission function is ON). ON / OFF of the conference image transmission function can be arbitrarily switched by a user operation. Whether the conference image transmission function is ON or OFF is determined with reference to a conference image transmission flag 730 (FIG. 7) described later.

  In the embodiment of the present invention, when the conference image transmission function is turned off, the web conference application of the mobile terminal 100 also interrupts the acquisition of the captured image from the camera application and the storage process as the conference image.

  The still image sharing button display unit 314 is a display unit that displays a button for acquiring a still image (still image) to be transmitted to the conference image transmission unit 312 and storing it in a memory (corresponding to an instruction unit display unit).

  The still image storage control unit 315 captures a captured image displayed on the display screen of the own device captured by the own camera when the button is pressed (by accepting a pressing operation instruction). The control unit performs control to store the acquired still image in the external memory as a conference image of the own device instead of the captured image. When the still image storage control unit 315 stores a still image as a conference image, the conference image transmission unit 312 transmits the still image as a conference image to another terminal.

  The conference image receiving unit 321 receives the conference image transmitted from each portable terminal 100, and the conference image storage unit 322 stores the received conference image for each terminal and user of the conference image transmission source. The conference image transmission unit 323 is a transmission unit that transmits each conference image stored in the conference image storage unit 322 to terminals participating in the same conference as each conference image other than the transmission source of each conference image. For example, assuming that the mobile terminals 100A to 100D are participating in the same conference, the conference images received from the mobile terminal 100A are transmitted to the mobile terminals 100B to 100D, respectively.

  The conference image receiving unit 316 receives the conference image of the other device transmitted from the server 200, and the conference image display unit 317 displays the received conference image of the other device and the conference image of the own device on the display screen.

  For example, the motion detection unit 318 acquires acceleration information (a value indicating the motion of the posture of the mobile terminal 100 in the real space) that is output from an acceleration sensor installed in the mobile terminal 100 itself. Detect and identify moving.

  The used camera specifying unit 319 is a specifying unit that specifies which of the in-camera and the out-camera installed in the mobile terminal 100 is being used. In the present embodiment, when a camera is used, a captured image captured by the camera is transmitted to the server 200. Therefore, the used camera specifying unit 319 transmits the captured image of any camera to another terminal. It functions as a specific part that identifies whether or not The above is the description of FIG.

  In the following description, it is assumed that the processing of each step in each flowchart is executed by a CPU of each device using a function included in an application installed in each device.

<First Embodiment>
Hereinafter, the first embodiment of the present invention will be described with reference to FIGS.

  First, with reference to FIG. 4, the outline of the processing in the first embodiment of the present invention will be described.

  In step S401, the mobile terminal 100 starts a web conference application in response to a user operation.

  In step S402, the mobile terminal 100 displays a login screen (not shown), accepts input of a user ID and password, and transmits the input user ID and password to the server 200, whereby a web conference application (client application and Login processing of the user of the user ID to the server application). Strictly speaking, when the server 200 that has received the user ID and password determines that the user ID and password are stored in the own machine (authentication has been successful), the user is logged in to the server application, By notifying the client application of the portable terminal 100 that the authentication is successful, the client application performs a user login process to itself. An example of the user ID and password is shown in the user information 700 of FIG.

  In step S403, the portable terminal 100 requests the server 200 for a menu screen (not shown) to be displayed after login. The menu screen is a screen for selecting a conference to be joined (a conference room in which the conference is held).

  In step S404, the server 200 receives the request, generates a menu screen in step S405, and transmits it to the mobile terminal 100. Specifically, html information (screen information) of the generated menu screen is transmitted. In the screen information, the selection unit of each conference room and the conference room ID are stored in association with each other.

  In step S406, the mobile terminal 100 receives the screen information, analyzes html, and displays it on the display screen.

  In step S <b> 407, the mobile terminal 100 accepts a conference room selection operation (selection operation for a conference to join) from the user. Then, the conference room ID of the selected conference room is specified from the screen information, and the entry request of the login user to the conference room is transmitted to the server 200. The milk request includes the user ID of the login user of the mobile terminal 100 and the terminal ID of the mobile terminal 100 itself.

  In step S408, the server 200 accepts the request, and in step S409, the server 200 performs a process of entering the requested conference room.

  Specifically, the user ID of the logged-in user is stored in association with the conference room that has been requested to enter the room and is stored in advance in the external memory of the server 200. An example of information indicating the association is shown in meeting information 710 in FIG. In step S409, the server 200 adds and stores the user ID of the logged-in user who is logged in at the portable terminal 100 that is the room entry request source, in the field of the participant ID 713 corresponding to the meeting room ID 711 of the meeting room requested to enter the room. . At this time, the terminal ID of the portable terminal 100 to which the user is logged in is stored in the terminal ID 714. The conference ID 712 is an ID of a conference held in the conference room with the conference room ID 711, and is deleted when the conference ends.

  Returning to the description of FIG. In step S410, the server 200 acquires the screen information of the conference screen shown in the conference screen 800 of FIG. 8 from the external memory of the own device, and transmits it to the mobile terminal 100. The screen information is, for example, html information indicating the layout of the screen, and does not include a conference image as indicated by 801 or 802. That is, it is template information of the conference screen.

  In step S411, the mobile terminal 100 receives the information on the conference screen and stores it in the memory. Further, the conference screen 800 is displayed on the display screen.

  In step S412, the mobile terminal 100 activates the camera. Specifically, the OS of the mobile terminal 100 is instructed to start a predetermined camera application installed in the camera application and start imaging. Here, first, the camera application is instructed to start imaging using the in-camera.

  Switching between the in-camera and the out-camera can be performed by accepting pressing of an “in / out switching” button on a screen (conference screen 800 (FIG. 8)) after entering a meeting room, which will be described later. Specifically, the web conferencing application instructs the camera application to switch between the in-camera and the out-camera, and if the camera application that accepted the instruction is using the in-camera, In this case, the camera to be used is switched to the in-camera.

  The portable terminal 100 repeats the processes of steps S413 to S414 until the logged-in user leaves the conference room that is entering the room.

  In step S413, the mobile terminal 100 acquires a captured image captured by the camera activated by the camera application from the camera application and stores it in the memory. Specifically, the captured images are sequentially stored in the conference image table 720 (FIG. 7) that stores images to be transmitted to the server 200 in step S414 described later (sequentially stored in the order of acquisition).

  The conference image table 720 is a table that accumulates and sequentially stores conference images for each conference image transmission source terminal. The transmission source terminal here is one of the mobile terminals 100A to 100D that transmit the conference image, and does not include the server 200.

  A terminal ID 721 is a terminal ID of a transmission source terminal that transmits the conference image. At the time of step S413, the terminal ID of the own device is stored. The sequence number 722 indicates the stored order of the conference images. The conference image 723 is entity data (image data) of the conference image. In the conference image 723, an image for each frame (one frame) of a moving image (moving image) captured by the camera is sequentially stored. C004, C005, and the like are image names. The name of the image is given a unique name by the web conference application when the web conference application acquires a captured image from the camera application.

  The transmitted flag 724 is a flag indicating an image that has been transmitted to the server 200. The transmitted flag 724 = 1 indicates that transmission has been completed, and the transmitted flag 724 = 0 indicates that transmission has not been performed.

  In step S414, the portable terminal 100 displays an undisplayed image in a predetermined display area of the display screen among the conference images of the own device (the conference image in which the terminal ID of the own device is stored in the terminal ID 721). For example, the conference image of the own device is displayed in the display area 801. Also, the oldest unsent conference image is acquired and transmitted to the server 200. After transmission, the transmitted flag 724 is changed to 1 to manage the conference image as transmitted on the conference image table.

  In step S415, the server 200 receives the conference image transmitted from the portable terminal 100, and in step S416, stores it in the memory in association with the terminal ID of the transmission source. Specifically, the conference image transmission source terminal ID (721) and the conference image (723) are stored in association with each other in the conference image table managed by the server application having the same configuration as the conference image table 720.

  On the other hand, the processing in steps S417 to S418 is repeated until the logged-in user leaves the conference room that is entering the room. The processes in steps S417 to S418 are started after the process in step S411.

  In step S <b> 417, the mobile terminal 100 transmits a request for acquiring a conference image of another device to the server 200.

  In step S420, the server 200 receives the request. In step S421, the server 200 acquires the conference image of the other device from the conference image table in its own memory in response to the request, and transmits it to the mobile terminal 100. In the conference image table of the server 200, the terminal ID of the transmitted mobile terminal 100 is inserted and stored in the field corresponding to the transmitted flag 724 instead of the flag. That is, which conference image is transmitted to which terminal is stored. In step S421, a conference image that has not yet been transmitted to the requesting mobile terminal 100 is identified, acquired, and transmitted.

  In step S418, the mobile terminal 100 sequentially receives the conference images and sequentially displays them in a predetermined storage area of the conference screen 800. For example, the conference image of each portable terminal is inserted into a small display area as shown in the display area 802 and displayed / updated. The above is the description of FIG.

  Next, with reference to FIG. 5, the flow of the on / off switching process of the conference image transmission function in the first embodiment of the present invention will be described.

  In step S501, the mobile terminal 100 accepts an instruction to press the “conference image transmission ON / OFF” button shown on the conference screen in FIG.

  In step S502, the portable terminal 100 acquires information indicating the transmission state of the conference image of the own device from the memory of the own device. For example, the conference image transmission flag 730 is acquired. A conference image transmission flag 730 indicates whether or not the own device is transmitting a conference image to an external device. The conference image transmission flag 730 = ON indicates that the conference image is being transmitted to the external device, that is, the conference image transmission function is valid. The conference image transmission flag 730 = OFF indicates a state where the conference image is not transmitted to the external apparatus (a state where transmission is stopped), that is, a state where the conference image transmission function is disabled.

  If the “conference image transmission ON / OFF” button is pressed and the conference image transmission flag 730 is ON, the process proceeds to step S503. If the conference image transmission flag 730 = OFF, the process proceeds to step S503.

  In step S503, the mobile terminal 100 stops the process of storing the captured image captured by the camera in the conference image table 720. Specifically, an application termination instruction is issued to the camera application activated in step S412. The camera application that has received the instruction ends, and imaging is stopped.

  In step S504, the mobile terminal 100 stops the conference image transmission process performed in step S414 of FIG. For example, the transmission function valid / invalid determination unit 313 instructs the conference image transmission unit 312 to stop transmission of the conference image, and the conference image transmission unit 312 that receives the instruction transmits the conference image to the external device. Cancel. In step S505, the mobile terminal 100 changes the conference image transmission flag 730 to OFF.

  In step S506, the mobile terminal 100 resumes the storage process of the captured image captured by the camera in the conference image table 720. Specifically, the OS of the mobile terminal 100 is instructed to start a predetermined camera application installed in the camera application and resume imaging.

  In step S507, the mobile terminal 100 resumes the conference image transmission process performed in step S414 of FIG. For example, the transmission function valid / invalid determination unit 313 instructs the conference image transmission unit 312 to start transmission of the conference image, and the conference image transmission unit 312 that receives the instruction transmits the conference image to the external device. To resume. In step S508, the portable terminal 100 changes the conference image transmission flag 730 to ON, and ends the process of FIG. The above is the description of FIG.

  Next, a flow of still image sharing processing in the first embodiment of the present invention will be described with reference to FIG.

  In step S601, the portable terminal 100 refers to the conference image transmission flag 730, and in step S602, determines whether the conference image transmission function is valid (determines whether the conference image is transmitted to an external device). If the conference image transmission function is enabled, the process proceeds to step S603. If the conference image transmission function is disabled, the “still image sharing” button is grayed out and cannot be pressed. The process shown in FIG. 6 ends.

  In step S <b> 603, the mobile terminal 100 displays a “still image sharing” button 803 on the conference screen 800 in a pressable manner. For example, the “still image sharing” button 803 is changed to an active state and displayed.

  That is, when the conference image transmission function is enabled, the state of the portable terminal 100 is changed to a state in which a still image can be transmitted.

  Further, when the conference image transmission function is enabled, a “still image sharing” button 803 is displayed to notify the user that the still image can be transmitted to another terminal and can be shared. be able to.

  When the pressing of the “still image sharing” button 803 is accepted in step S604, the portable terminal 100 receives the pressing of the “still image sharing” button 803 in step S605, and in step S412 of FIG. It is determined whether a captured image is being transmitted to the server 200 or a still image is being transmitted.

  For example, an image name (conference image 723) transmitted during a predetermined time in the past is acquired, and an image with the same name is continuously transmitted to the server 200 for a predetermined time (for example, the past 2 seconds). In this case, it is determined that a still image is being transmitted. When images having different names are sequentially transmitted to the server 200 for a predetermined time (for example, the past 2 seconds), it is determined that the captured image is being transmitted.

  If it is determined that a captured image is being transmitted, the process proceeds to step S606. If it is determined that a still image is being transmitted, the process proceeds to step S609.

  In step S <b> 606, the mobile terminal 100 captures (acquires and stores in the memory) the captured image displayed on the display screen at the time when the pressing of the “still image sharing” button 803 is accepted.

  In step S607, the portable terminal 100 stops the storage process of the captured image captured by the camera application in the conference image table 720.

  In step S608, the portable terminal 100 inserts and stores the still image captured in step S606 into the conference image 723 in the conference image table 720. Even if the conference image (still image) is transmitted to the server 200, the conference image is transmitted so that the transmission flag 724 is not transmitted yet (= 1), and is always in an untransmitted state (= 0). To the department. Thereby, even if a still image is transmitted, the process of updating the transmitted flag 724 from 0 to 1 is stopped. Therefore, in step S412, the conference image transmission unit repeatedly transmits the still image, which is the oldest image managed as untransmitted, to the server 200.

  A conference screen 800 in FIG. 8 shows a state in which a captured image is displayed in the display area 801 and the captured image is transmitted to another terminal. The conference screens 810 and 820 in FIG. 8 show a state in which the pressing of the “still image sharing” button 803 is accepted and a still image is transmitted to another terminal. As indicated by reference numeral 801 in FIG. 8, when a captured image is being transmitted, “moving video sharing” is displayed. When a still image is being transmitted, “still image sharing” is displayed. The user is notified that the image is being transmitted.

  In step S609, the mobile terminal 100 instructs the camera application to resume the storage process of the captured image captured by the camera application in the conference image table 720. Further, the transmission completion flag 724 of the still image that has been transmitted until immediately before is changed to transmission completed (= 1).

  As described above, according to the first embodiment of the present invention, it is possible to provide a mechanism that allows a newly acquired image to be easily transmitted using a function that has already been used for image transmission. .

  Specifically, using a communication that has transmitted a captured image to another terminal participating in the same conference, a service (function) for transmitting a still image is newly activated and communication is established. And still images can be easily transmitted.

  When the web conference application issues an instruction to the camera application and does not respond normally (for example, the camera application is not operating normally), the web conference application automatically sets the conference image transmission flag 730 to OFF. In the first place, when the mobile terminal 100 does not include a camera device or the camera device is not connected to the mobile terminal 100, the web conference application automatically sets the conference image transmission flag 730 to OFF. The fact that the portable terminal 100 does not include a camera device or that the camera device is not connected to the portable terminal 100 means that when the OS requests the OS to start a camera application, the OS does not include the camera device. Alternatively, it can be specified by receiving a response that the camera device is not connected to the portable terminal 100.

  <Second Embodiment>

  Hereinafter, the second embodiment of the present invention will be described with reference to FIGS. 9 and 10. Note that description of processes, screens, and data common to the first embodiment is omitted.

  The mobile terminal 100 executes the process in FIG. 9 immediately after step S602 in FIG.

  In step S <b> 901, the mobile terminal 100 acquires acceleration information acquired from the acceleration sensor 212 of the own device and stored in the memory. The acceleration information here is, for example, the acceleration information 1000 in FIG. The acceleration information 1000 is information in which a history of acceleration of the mobile terminal 100 is recorded. Here, it is assumed that acceleration is acquired from the acceleration sensor 212 every 0.1 second and stored.

  In step S902, the mobile terminal 100 determines whether the mobile terminal 100 is moving in real space. Specifically, it is determined that the mobile terminal is moving when there is a change in acceleration (values of x, y, z) exceeding a threshold value in the past 0.5 seconds of the acceleration information 1000. In the present embodiment, it is assumed that the threshold value is 0.1. The state in which the mobile terminal 100 is moving is assumed to be a state in which the mobile terminal 100 is held in the user's hand and is attached to the user's body, for example.

  On the other hand, if the acceleration (value of x, y, z) has not changed beyond the threshold during the past 0.5 seconds of the acceleration information 1000, it is determined that the mobile terminal 100 is not moving. The state where the mobile terminal 100 is not moving (the state where it is stationary) is assumed to be a state where the mobile terminal 100 is placed on a table, for example.

  If it is determined that the mobile terminal 100 is not moving, the process ends. If it is determined that the mobile terminal 100 is moving, the process proceeds to step S603 in FIG. 6 and the “still image sharing” button 803 is pressed. Display as possible.

  In the acceleration information 1000 in FIG. 10, the mobile terminal moves when viewed for 0.2 seconds from 10: 22: 21: 01 on July 26, 2016 to 10: 22: 21: 03 on July 26, 2016. It is not in a state. In the 0.5 second period from 10: 22: 21: 03 on July 26, 2016 to 10: 22: 21: 08 on July 26, 2016, it indicates that the mobile terminal is moving. .

  According to the second embodiment of the present invention, for example, when a mobile terminal is placed on a desktop to capture, transmit, and transmit a moving image of the subject for the purpose of monitoring the motion of the subject, When the moving image of the user's face is transmitted by the in-camera installed in the camera, for example, it is possible to prevent the start of transmission of a still image due to an erroneous operation.

  In addition, when a mobile terminal is moving and there is a possibility that camera shake, focus shift, or the like may occur, a still image can be transmitted as a conference image.

  <Third Embodiment>

  Hereinafter, the third embodiment of the present invention will be described with reference to FIGS. 11 and 12. Note that description of processes, screens, and data common to the first embodiment is omitted.

  In the third embodiment, still image sharing is not performed when the in-camera is used, and still image sharing is possible when the out-camera is used.

  When using the in-camera, generally, an image of the user himself (for example, a face image) using the terminal is often captured. If the face image becomes a still image, the voice uttered by the user and the face image do not work together, which may cause a sense of discomfort. Therefore, it is desirable to avoid sharing the still image. Therefore, in the third embodiment, when the in-camera is used, the “still image sharing” button is not displayed so as to be operable (for example, grayed out), thereby preventing the sharing of the still image of the face image. .

  The mobile terminal 100 executes the process in FIG. 11 immediately after step S602 in FIG.

  In step S1101, the portable terminal 100 reads the in-camera use flag 1200 stored in the external memory of the own device on the memory and refers to it.

  The in-camera use flag 1200 = ON indicates that the in-camera is being used. The in-camera use flag 1200 = OFF indicates that the out-camera is being used. The in-camera use flag 1200 is stored with the ON value inserted and stored by the web conference application at the time of step S412 in FIG. 4, and then the “in / out switch” button is pressed (in-camera by the camera application). The web conferencing application is turned off (by switching from the camera to the out camera). In addition, when the “in / out switching” button is pressed in the state where the in-camera use flag 1200 is OFF (by switching from the out-camera to the in-camera by the camera application), the web conference application is turned on. change.

  In step S1102, the mobile terminal 100 determines (specifies) whether the in-camera is used or the out-camera is used. If the in-camera is used, the process ends. If the out-camera is used, the portable terminal 100 performs the process. The process advances to step S603 to display a “still image sharing” button 803 that can be pressed.

  According to the third embodiment of the present invention, still image sharing is not performed when the in-camera is used, and still image sharing is possible when the out-camera is used.

  As described above, according to the present invention, it is possible to provide a mechanism that makes it possible to easily transmit a newly acquired image using a function already used for image transmission.

  Therefore, a still image can be easily shared during a meeting.

  In the above description of the embodiment, the “still image sharing” button is displayed so that it can be pressed when the transmission function is enabled, and the “still image sharing” button is not pressed when the transmission function is disabled. However, if the transmission function is disabled, the “still image sharing” button may not be displayed in the first place.

  In the description of the above-described embodiment, whether or not to transmit a still image depends on whether the transmission function is enabled or disabled (displays a “still image sharing” button so that a still image can be transmitted). For example, it is determined whether the captured image can be acquired from the camera application, and in the state where the captured image can be acquired, the state of the mobile terminal can transmit the still image If the captured image cannot be acquired, the state of the mobile terminal may be changed to a state in which a still image is not transmitted. Specifically, instead of step S602 in FIG. 6, it is determined whether a captured image is acquired from the camera application. If acquired, the process proceeds to step S603, and if not, the process is performed. Exit. For example, referring to the record of the conference image table 720, when a predetermined number or more (for example, 25 or more) of captured images are added to the conference image table 720 for a predetermined time (for example, for the past 5 seconds). When it is determined that a captured image is acquired from the camera application, and a predetermined number or more (for example, 25 or more) of captured images are not added to the conference image table 720, it is determined that a captured image is not acquired. And Note that this determination method is merely an example, and other determination methods may be used.

  In this way, for example, even when the conference image transmission function is temporarily disabled, a still image can be captured and stored in the conference image table 720, and the conference image transmission is resumed. You can start sending still images.

  In the above description of the embodiment, each screen information is generated by the server 200 and the screen is displayed by the mobile terminal 100 receiving the screen information. However, the screen information is stored in advance in the mobile terminal 100. In this case, the screen information request, generation, and transmission / reception processes are omitted, and the screen information stored in its own memory is read and displayed on the display screen.

  It should be noted that the present invention can be implemented as, for example, a system, apparatus, method, program, or storage medium, and can be applied to a system composed of a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Specifically, the mobile terminal 100 and the server 200 may be integrated, and the processing of each step of the above-described embodiment may be executed as one housing.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto.
That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100A mobile terminal 100B mobile terminal 100C mobile terminal 100D mobile terminal 101 network 200 server

Claims (11)

An information processing apparatus including an imaging device capable of communicating with a plurality of information processing apparatuses including a display unit,
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
Still image storage control means for controlling to store still images;
A determination unit for determining whether an image is transmitted by the transmission unit;
When the determination unit determines that the image is transmitted by the transmission unit, the transmission unit is configured to transmit the still image stored by the still image storage control unit to the plurality of information processing apparatuses. Control means for controlling;
An information processing apparatus comprising: Instruction unit display means for displaying an instruction unit for controlling storage of a still image by the still image storage control unit on the display unit when the determination unit determines that an image is transmitted by the transmission unit When,
With
The still image storage control unit controls to store a still image of an image displayed on the display unit when an operation instruction to the instruction unit displayed by the instruction unit display unit is received. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 2, wherein the instruction unit display unit displays the instruction unit on a display unit when the information processing apparatus is moving in a real space. The information processing device includes an in camera and an out camera as the imaging device,
When the image captured by the in-camera is transmitted by the transmitting unit, the instruction unit display unit displays the image captured by the out-camera without displaying the instruction unit. The information processing apparatus according to claim 2, wherein the instruction unit is displayed.   The control unit stores the still image stored by the still image storage control unit as an image to be transmitted by the transmission unit, thereby causing the transmission unit to transmit the still image. 5. The information processing apparatus according to any one of items 4 to 4.   The control unit instructs the transmission unit to transmit the still image stored by the still image storage control unit to the plurality of information processing apparatuses, thereby causing the transmission unit to transmit the still image. The information processing apparatus according to any one of claims 1 to 5. A method for controlling an information processing apparatus including an imaging device capable of communicating with a plurality of information processing apparatuses including a display unit,
A transmission step of sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
A still image storage control process for controlling to store still images;
A determination step of determining whether an image is transmitted by the transmission step;
When it is determined in the determination step that the image is transmitted in the transmission step, the transmission step is configured to cause the plurality of information processing apparatuses to transmit the still images stored in the still image storage control step. A control process to control;
A method for controlling an information processing apparatus, comprising: A program for controlling an information processing device including an imaging device, which can communicate with a plurality of information processing devices including a display unit,
The information processing apparatus;
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
Still image storage control means for controlling to store still images;
A determination unit for determining whether an image is transmitted by the transmission unit;
When the determination unit determines that the image is transmitted by the transmission unit, the transmission unit is configured to transmit the still image stored by the still image storage control unit to the plurality of information processing apparatuses. A program for an information processing apparatus that functions as a control means for controlling. An information processing system including a plurality of information processing devices including an imaging device,
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
Still image storage control means for controlling to store still images;
A determination unit for determining whether an image is transmitted by the transmission unit;
When the determination unit determines that the image is transmitted by the transmission unit, the transmission unit is configured to transmit the still image stored by the still image storage control unit to the plurality of information processing apparatuses. Control means for controlling;
Receiving means for sequentially receiving images transmitted by the transmitting means;
Display means for sequentially displaying images received by the receiving means on a display unit;
An information processing system comprising: A control method of an information processing system including a plurality of information processing devices including an imaging device,
A transmission step of sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
A still image storage control process for controlling to store still images;
A determination step of determining whether an image is transmitted by the transmission step;
When it is determined in the determination step that the image is transmitted in the transmission step, the transmission step is configured to cause the plurality of information processing apparatuses to transmit the still images stored in the still image storage control step. A control process to control;
A receiving step of sequentially receiving the images transmitted by the transmitting step;
A display step of sequentially displaying the images received in the reception step on a display unit;
A method for controlling an information processing system comprising: A program for controlling an information processing system including a plurality of information processing devices including an imaging device,
The information processing system;
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
Still image storage control means for controlling to store still images;
A determination unit for determining whether an image is transmitted by the transmission unit;
When the determination unit determines that the image is transmitted by the transmission unit, the transmission unit is configured to transmit the still image stored by the still image storage control unit to the plurality of information processing apparatuses. Control means for controlling;
Receiving means for sequentially receiving images transmitted by the transmitting means;
A program for an information processing system that causes an image received by the receiving means to function as display means for sequentially displaying the image on a display unit.

Images