JP6652711B2 - Information processing apparatus, information processing system, control method thereof, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing system, a control method thereof, and a program.

  In recent years, web conferencing systems have become popular. In addition, a web conference system using a mobile terminal is generally provided.

  For example, Patent Literature 1 describes a technology for performing a web conference using a mobile terminal. According to Patent Literature 1, when a web conference is performed on a mobile terminal, an image is captured using a camera mounted on the mobile terminal itself or a camera separately installed and connected on the mobile terminal, and the image is captured. To other terminals participating in the meeting.

JP 2015-82207 A JP 2013-027037 A

  When it is desired to inform the user of another terminal participating in the conference of the situation of the site, such as a construction site or an event site, outdoors, for example, the out-camera of the mobile terminal (the camera installed on the back of the mobile terminal) It is conceivable that an image of the scene at the site is used and transmitted to another terminal. However, it is troublesome to perform the task while simultaneously performing the task of capturing an image and the conversation with another user participating in the conference. In addition, even if a conversation can be performed while capturing an image, for example, if the user concentrates on the conversation and loses consciousness from an image capturing operation, the possibility of occurrence of camera shake or out of focus increases. In some cases, the desired image cannot be shared with other terminals.

  Patent Document 2 discloses a technique of transmitting an image captured by a mobile terminal to an external device using a dedicated service or transmitting the image by e-mail. However, it takes time and effort to launch another application or service and specify a desired destination to transmit.

  An object of the present invention is to provide a mechanism that enables a newly acquired image to be easily transmitted using a function already used for image transmission.

  An information processing apparatus according to an aspect of the present invention is an information processing apparatus including an imaging device that is capable of communicating with a plurality of information processing apparatuses including a display unit. A transmitting unit for sequentially transmitting the image, a still image storing control unit for controlling a still image to be stored, a determining unit for determining whether the image is transmitted by the transmitting unit, and the transmitting unit for transmitting the image. Control means for controlling the transmission means to transmit the still image stored by the still image storage control means to the plurality of information processing devices, when it is determined that the image has been transmitted by the means, It is characterized by having.

  According to the present invention, it is possible to provide a mechanism that can easily transmit a newly acquired image by using a function already used for image transmission.

  For example, it is possible to provide a mechanism that allows a still image to be easily shared using a function of sequentially transmitting and sharing moving images for a meeting during a meeting.

FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a hardware configuration of various devices according to the embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a functional configuration of various devices according to the embodiment of the present invention. 5 is a flowchart illustrating an outline of a process according to the first embodiment of the present invention. 5 is a flowchart illustrating a flow of an on / off switching process of a conference image transmission function according to the first embodiment of the present invention. 5 is a flowchart illustrating a flow of a still image sharing process according to the first embodiment of the present invention. FIG. 3 is a diagram illustrating an example of various data configurations according to the first embodiment of the present invention. FIG. 5 is a diagram illustrating an example of a configuration of a conference screen and a state of transition according to the first embodiment of the present invention. It is a figure in the 2nd Embodiment of this invention which shows an example of a structure of the display screen of a still image sharing process. FIG. 11 is a diagram illustrating an example of various data configurations according to the second embodiment of the present invention. It is a figure in the 3rd Embodiment of this invention which shows an example of a structure of the display screen of a still image sharing process. FIG. 14 is a diagram illustrating an example of various data configurations according to a third embodiment of the present invention.

  Hereinafter, an example of an embodiment of the present invention will be described with reference to the drawings.

  First, an example of a configuration of an information processing system according to an embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 1, in the information processing system of the present invention, the server 200 and the mobile terminal 100 (general term for the mobile terminal 100A, the mobile terminal 100B, the mobile terminal 100C, and the mobile terminal 100D) can communicate via the network 101. Connected to and configured.

  The server 200 has various functions for executing a web conference using the mobile terminal 100. For example, creation and storage of a room for a web conference, identification information of the mobile terminal 100 and a conference image received from each mobile terminal (for example, a captured image (video) which is image data of a user who is a conference participant). It performs storage, storage of information on the association between the conference image and the terminal that has transmitted the conference image, and control of transmission processing of the conference image to each terminal.

  The mobile terminal 100 is a terminal having a camera function and a touch panel function (operation unit). The mobile terminal 100 is installed on an in-camera (a camera installed on the side where the display is installed) and an out-camera (on the back of the mobile terminal / an opposite side to the side where the display is installed). Camera).

  The mobile terminal 100 uses the function of the conference application to log in to the server 200 in response to an operation from the user, and transmits an image (conference image / video) captured and acquired by the camera to the same via the server 200. Is sequentially transmitted to the other mobile terminals 100 that are entering the room (participating in the conference).

  In addition to the image data acquired from the camera, data stored in the mobile terminal 100, such as static data such as a photographic image or document data such as a PDF file, is transferred to another mobile terminal 100 via the server 200. It has a file sharing function of transmitting to the terminal 100 and sharing.

  Further, the conference application has an application image sharing function of transmitting and sharing an image of a screen of an application other than the conference application running on the mobile terminal 100 to another mobile terminal. The above is an explanation of an example of the configuration of the information processing system in the embodiment of the present invention in FIG.

  Next, an example of a hardware configuration of various devices according to the embodiment of the present invention will be described with reference to FIG.

  In FIG. 2, reference numeral 201 denotes a CPU, which comprehensively controls each device and controller connected to the system bus 204. The ROM 202 or the external memory 211 includes a basic input / output system (BIOS) or an operating system program (hereinafter, referred to as an OS), which is a control program of the CPU 201, and a function to be executed by each server or each PC. Various programs described later are stored.

  A RAM 203 functions as a main memory, a work area, and the like for the CPU 201. The CPU 201 loads various programs and the like necessary for executing processing from the ROM 202 or the external memory 211 into the RAM 203 and executes the loaded programs to realize various operations.

  An input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display such as a CRT display (CRT) 210. In FIG. 2, the CRT 210 is described, but the display is not limited to the CRT but may be another display such as a liquid crystal display. These are used by the administrator as needed.

  In the embodiment of the present invention, the CRT 210 of the mobile terminal 100 has a touch panel function. When the CRT 210 has a touch panel function, the CRT 210 also functions as an input device, and transmits, to the input controller, information on a touch operation detected by the touch panel function (accepted on the display) as input information. That is, the input controller 205 controls input from the CRT 210.

  A memory controller 207 is connected to a hard disk (HD) for storing a boot program, various applications, font data, user files, edit files, various data, and the like, a flexible disk (FD), or a PCMCIA card slot via an adapter. Access to an external memory 211 such as a compact flash (registered trademark) memory.

  A communication I / F controller 208 connects and communicates with an external device via a network (for example, the network 101 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables the display on the CRT 210 by executing, for example, an outline font developing (rasterizing) process on a display information area in the RAM 203. Further, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  Various programs described below for realizing the present invention are recorded in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. Further, a definition file and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.

  An acceleration sensor 212 detects, for example, the acceleration of the portable terminal 100. When the acceleration sensor is attached to a device such as the mobile terminal 100 as an external device, for example, the acceleration sensor 212 transmits information of the detected acceleration to the mobile terminal 100 by communicating with the input controller 205. The information on the acceleration is accumulated and stored, for example, on the RAM 203 as the operation history of the mobile terminal. The above is an explanation of an example of the hardware configuration of various devices in the embodiment of the present invention in FIG.

  Next, an example of a functional configuration of various devices according to the embodiment of the present invention will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of a functional configuration of various devices according to the embodiment of the present invention.

  The functional units 311 to 319 in FIG. 3 are functional units included in a web conference application (client application) installed in the mobile terminal 100. Each of the functional units 322 to 323 is a functional unit included in a web conference application (server application) installed in the server 200.

  The captured image storage control unit 311 transmits the captured image captured by the camera to another terminal (for example, the mobile terminals 100B to 100D for the mobile terminal 100A) participating in the conference, and the conference image of the own device. And a control unit that performs control to store the data in an external memory.

  The conference image transmitting unit 312 transmits a conference image of the own device stored in the own device to the server 200 (transmits to the other terminal participating in the same conference as the own device via the server 200). It is. When an untransmitted conference image is transmitted, information indicating that the conference image has been transmitted is stored in association with the conference image, so that the transmitted conference image and the untransmitted conference image are managed separately.

  The transmission function validity / invalidity determination unit 313 is a determination unit that determines whether the conference image transmission unit 312 is functioning (whether the conference image transmission function is ON). ON / OFF of the conference image transmission function can be arbitrarily switched by a user operation. Whether the transmission function of the conference image is ON or OFF is determined by referring to a conference image transmission flag 730 (FIG. 7) described later.

  In the embodiment of the present invention, when the transmission function of the conference image is turned off, the web conference application of the mobile terminal 100 also interrupts the acquisition of the captured image from the camera application and the storage process as the conference image.

  The still image sharing button display unit 314 is a display unit that displays a button for acquiring a still image (still image) to be transmitted to the conference image transmitting unit 312 and storing it in the memory (corresponding to an instruction unit display unit).

  When the button is pressed (by receiving an operation instruction for pressing), the still image storage control unit 315 captures a captured image displayed on the display screen of the own device captured by the camera of the own device. And a control unit that controls to store the obtained still image in the external memory as a conference image of the own device instead of the captured image. When a still image is stored as a conference image by the still image storage control unit 315, the conference image transmission unit 312 transmits the still image to another terminal as a conference image.

  The conference image receiving unit 321 receives the conference image transmitted from each mobile terminal 100, and the conference image storage unit 322 stores the received conference image for each terminal and user who transmitted each conference image. The conference image transmission unit 323 is a transmission unit that transmits each conference image stored in the conference image storage unit 322 to terminals that are participating in the same conference as each conference image, except for the source of each conference image. For example, assuming that the mobile terminals 100A to 100D are participating in the same conference, the conference images received from the mobile terminal 100A are transmitted to the mobile terminals 100B to 100D, respectively.

  The conference image receiving unit 316 receives the conference image of the other device transmitted from the server 200, and the conference image display unit 317 displays the received conference image of the other device and the conference image of the own device on a display screen.

  The movement detection unit 318 acquires, for example, acceleration information (a value indicating the movement of the posture of the portable terminal 100 in the real space) output from the acceleration sensor installed in the portable terminal 100 itself, and Detects movement and identifies it.

  The used camera specifying unit 319 is a specifying unit that specifies which of the in-camera and the out-camera installed in the mobile terminal 100 is being used. In the present embodiment, when a camera is used, the captured image captured by the camera is transmitted to the server 200. Therefore, the used camera identification unit 319 transmits the captured image of any camera to another terminal. It functions as a specifying unit that specifies whether or not it has been performed. The above is the description of FIG.

  In the following description, it is assumed that the processing of each step of each flowchart is executed by the CPU of each device by using a function of an application installed in each device.

<First embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS.

  First, with reference to FIG. 4, an outline of a process according to the first embodiment of the present invention will be described.

  In step S401, the mobile terminal 100 activates a web conference application according to a user operation.

  In step S402, the mobile terminal 100 displays a login screen (not shown) to accept the input of the user ID and the password, and transmits the input user ID and the password to the server 200. To the server application) for the user of the user ID. Strictly, when the server 200 that has received the user ID and the password determines that the user ID and the password are stored in its own device (authentication was successful), the server 200 executes login of the user to the server application, By notifying the client application of the portable terminal 100 of the success of the authentication, the client application performs a user login process to itself. An example of the user ID and the password is shown in the user information 700 of FIG.

  In step S403, the mobile terminal 100 requests the server 200 for a menu screen (not shown) to be displayed after login. The menu screen is a screen for selecting a meeting to join (a meeting room where the meeting is held).

  In step S404, the server 200 receives the request, generates a menu screen in step S405, and transmits the menu screen to the mobile terminal 100. Specifically, the html information (screen information) of the generated menu screen is transmitted. In the screen information, the selection unit of each conference room and the conference room ID are stored in association with each other.

  In step S406, the mobile terminal 100 receives the screen information, analyzes the html, and displays the html on the display screen.

  In step S407, the mobile terminal 100 accepts a user's operation of selecting a conference room to enter (selection of a conference to join). Then, the conference room ID of the selected conference room is specified from the screen information, and the entry request of the login user to the conference room is transmitted to the server 200. The milk request includes the user ID of the login user of the mobile terminal 100 and the terminal ID of the mobile terminal 100 itself.

  In step S408, the server 200 accepts the request, and in step S409, performs processing for allowing the login user to enter the requested conference room.

  Specifically, the user ID of the login user is stored in association with the conference room for which the entry request has been made, which is stored in the external memory of server 200 in advance. An example of the information indicating the association is shown in the conference information 710 in FIG. In step S409, the server 200 adds and stores the user ID of the logged-in user who has logged in the portable terminal 100 of the entry request source in the column of the participant ID 713 corresponding to the conference room ID 711 of the conference room requested to enter. . At this time, the terminal ID of the portable terminal 100 to which the user is logged in is stored in the terminal ID 714. The conference ID 712 is the ID of the conference held in the conference room with the conference room ID 711, and is deleted when the conference ends.

  Returning to the description of FIG. In step S410, server 200 acquires the screen information of the conference screen shown in conference screen 800 of FIG. 8 from its own external memory and transmits it to portable terminal 100. The screen information is, for example, html information indicating the layout of the screen, and does not include a conference image such as 801 or 802. That is, the template information of the conference screen.

  In step S411, the mobile terminal 100 receives the information of the conference screen and stores the information in the memory. Further, the conference screen 800 is displayed on the display screen.

  In step S412, the mobile terminal 100 activates the camera. Specifically, it instructs the OS of the mobile terminal 100 to start a predetermined camera application installed in the camera application and start imaging. Here, it is assumed that the camera application is instructed to start imaging using the in-camera.

  Switching between the in-camera and the out-camera can be performed by receiving a press of an “in / out switch” button on a screen (meeting screen 800 (FIG. 8)) after entering a meeting room described later. Specifically, the web conference application instructs the camera application to switch between the in-camera and the out-camera, and the camera application that receives the instruction instructs the out-camera to use the out-camera when the in-camera is being used. In this case, the camera to be used is switched to the in-camera.

  The mobile terminal 100 repeats the processing of steps S413 to S414 until the logged-in user leaves the conference room in which the user is entering.

  In step S413, the mobile terminal 100 acquires a captured image captured by the camera activated by the camera application from the camera application, and stores the acquired image in the memory. Specifically, the captured images are sequentially stored in the conference image table 720 (FIG. 7) that stores the images to be transmitted to the server 200 in step S414 described later (sequentially stored in the order of acquisition).

  The conference image table 720 is a table for accumulating and sequentially storing conference images for each terminal that has transmitted the conference image. The source terminal here is any of the mobile terminals 100A to 100D that transmit the conference image, and does not include the server 200.

  The terminal ID 721 is the terminal ID of the terminal that transmits the conference image. At the time of step S413, the terminal ID of the own device is stored. The sequence number 722 indicates the order in which the conference images are stored. The conference image 723 is entity data (image data) of the conference image. In the meeting image 723, an image for each frame (one frame) of a moving image (moving image) captured by the camera is sequentially stored. C004, C005, etc. are the names of the images. The name of the image is given a unique name by the web conference application when the web conference application acquires the captured image from the camera application.

  The transmitted flag 724 is a flag indicating an image that has been transmitted to the server 200. The transmitted flag 724 = 1 indicates that transmission has been performed, and the transmitted flag 724 = 0 indicates that transmission has not been performed.

  In step S414, the mobile terminal 100 displays an undisplayed image in a predetermined display area of the display screen among the conference images of the mobile terminal 100 (the conference image whose terminal ID is stored in the terminal ID 721). For example, a conference image of the own device is displayed in the display area 801. Further, the oldest untransmitted conference image is acquired and transmitted to the server 200. After the transmission, the transmitted flag 724 is changed to 1 in order to manage the conference image as transmitted on the conference image table.

  In step S415, the server 200 receives the conference image transmitted from the mobile terminal 100, and stores it in the memory in step S416 in association with the terminal ID of the transmission source. Specifically, the terminal ID (721) of the transmission source of the conference image and the conference image (723) are stored in association with each other in a conference image table managed by the server application having the same configuration as the conference image table 720.

  On the other hand, the processing of steps S417 to S418 is also repeated until the logged-in user leaves the conference room in which the room has been entered. The processing of steps S417 to S418 starts after the processing of step S411.

  In step S417, the mobile terminal 100 transmits a request to acquire a conference image of another device to the server 200.

  In step S420, the server 200 receives the request, and in step S421, acquires the conference image of the other device from the conference image table in its own memory according to the request, and transmits it to the mobile terminal 100. In the conference image table of the server 200, the terminal ID of the transmitted portable terminal 100 is inserted and stored in the column corresponding to the transmitted flag 724 instead of the flag. That is, it stores which conference image was transmitted to which terminal. In step S421, a conference image that has not been transmitted to the requesting mobile terminal 100 is specified, acquired, and transmitted.

  In step S418, mobile terminal 100 sequentially receives the conference images and sequentially displays them in a predetermined storage area of conference screen 800. For example, a conference image of each mobile terminal is inserted and displayed / updated in a small display area such as the display area 802. The above is the description of FIG.

  Next, with reference to FIG. 5, the flow of the on / off switching process of the conference image transmission function in the first embodiment of the present invention will be described.

  In step S501, the mobile terminal 100 receives an instruction to press a “conference image transmission ON / OFF” button shown in the conference screen of FIG.

  In step S502, the mobile terminal 100 acquires information indicating the transmission state of the conference image of the mobile terminal 100 from the memory of the mobile terminal 100. For example, the conference image transmission flag 730 is acquired. The conference image transmission flag 730 indicates whether or not the own device is transmitting a conference image to an external device. The conference image transmission flag 730 = ON indicates that the conference image is being transmitted to the external device, that is, the conference image transmission function is enabled. The conference image transmission flag 730 = OFF indicates a state in which the conference image is not transmitted to the external device (a state in which transmission is stopped), that is, a state in which the conference image transmission function is disabled.

  If the conference image transmission flag 730 is ON when the “conference image transmission ON / OFF” button is pressed, the process proceeds to step S503. If the conference image transmission flag 730 is OFF, the process moves to step S503.

  In step S503, the mobile terminal 100 stops the process of storing the captured image captured by the camera in the conference image table 720. More specifically, the camera application started in step S412 is instructed to terminate the application. The camera application that has received the instruction ends, and stops imaging.

  In step S504, the mobile terminal 100 stops the conference image transmission process performed in step S414 in FIG. For example, the transmission function validity / invalidity determination unit 313 instructs the conference image transmission unit 312 to stop transmitting the conference image, and the conference image transmission unit 312 that has received the instruction transmits the conference image to the external device. To stop. In step S505, the mobile terminal 100 changes the conference image transmission flag 730 to OFF.

  In step S506, the portable terminal 100 resumes the process of storing the captured image captured by the camera in the conference image table 720. Specifically, it instructs the OS of the mobile terminal 100 to start a predetermined camera application installed in the camera application and restart imaging.

  In step S507, the mobile terminal 100 resumes the conference image transmission process performed in step S414 in FIG. For example, the transmission function valid / invalid determination unit 313 instructs the conference image transmission unit 312 to start transmitting the conference image, and the conference image transmission unit 312 that has received the instruction transmits the conference image to the external device. Resume. In step S508, the mobile terminal 100 changes the conference image transmission flag 730 to ON, and ends the processing in FIG. The above is the description of FIG.

  Next, the flow of the still image sharing process according to the first embodiment of the present invention will be described with reference to FIG.

  In step S601, the mobile terminal 100 refers to the conference image transmission flag 730, and determines in step S602 whether the conference image transmission function is valid (determines whether the conference image is transmitted to an external device). If the conference image transmission function is enabled, the process proceeds to step S603. If the conference image transmission function is disabled, the “still image sharing” button is grayed out and cannot be pressed. And the process of FIG. 6 ends.

  In step S603, the mobile terminal 100 displays a “still image sharing” button 803 on the conference screen 800 so as to be able to be pressed. For example, the “still image sharing” button 803 is changed to an active state and displayed.

  That is, when the transmission function of the conference image is enabled, the state of the mobile terminal 100 is changed to a state in which still images can be transmitted.

  Further, when the conference image transmission function is enabled, a “still image sharing” button 803 is displayed to notify the user that the still image can be transmitted to another terminal and shared. be able to.

  In step S604, when the “still image sharing” button 803 is pressed, in step S605, the portable terminal 100 receives the pressing of the “still image sharing” button 803, and in step S412 in FIG. It is determined whether a captured image is being transmitted to the server 200 or a still image is being transmitted.

  For example, the name of the image (conference image 723) transmitted during a predetermined time in the past is acquired, and the image having the same name is continuously transmitted to the server 200 for a predetermined time (for example, the past 2 seconds). In this case, it is determined that the still image is being transmitted. If images with different names are sequentially transmitted to the server 200 for a predetermined time (for example, the past two seconds), it is determined that the captured image is being transmitted.

  If it is determined that the captured image is being transmitted, the process proceeds to step S606. If it is determined that a still image is being transmitted, the process proceeds to step S609.

  In step S606, the mobile terminal 100 captures the captured image displayed on the display screen (acquires and stores the captured image in the memory) when the “still image sharing” button 803 is pressed.

  In step S607, the portable terminal 100 stops storing the captured image captured by the camera application in the conference image table 720.

  In step S608, the mobile terminal 100 inserts the still image captured in step S606 into the conference image 723 of the conference image table 720 and stores it. Then, even if the conference image (still image) is transmitted to the server 200, the conference image transmission is performed such that the transmitted flag 724 is not changed to transmitted (= 1) and is always in a non-transmitted state (= 0). Instruct the department. As a result, even when a still image is transmitted, the process of updating the transmitted flag 724 from 0 to 1 stops. Therefore, in step S412, the conference image transmitting unit repeatedly transmits the still image, which is the oldest image managed as untransmitted, to the server 200.

  The conference screen 800 in FIG. 8 shows a state in which a captured image is displayed in the display area 801 and the captured image is being transmitted to another terminal. The conference screens 810 and 820 in FIG. 8 show a state in which a “still image sharing” button 803 has been pressed and a still image is being transmitted to another terminal. As shown at 801 in FIG. 8, when a captured image is being transmitted, “moving image sharing” is displayed, and when a still image is being transmitted, “still image sharing” is displayed. The user is notified that the image is being transmitted.

  In step S609, the mobile terminal 100 instructs the camera application to restart the process of storing the captured image captured by the camera application in the conference image table 720. In addition, the transmission completion flag 724 of the still image transmitted until immediately before is changed to transmission completed (= 1).

  As described above, according to the first embodiment of the present invention, it is possible to provide a mechanism that can easily transmit a newly acquired image by using a function already used for image transmission. .

  Specifically, a new service (function) for still image transmission is started and communication is established with another terminal participating in the same conference using the communication that transmitted the captured image. And still images can be easily transmitted.

  If the web conferencing application does not respond normally even when giving an instruction to the camera application (for example, the camera application is not operating normally), the web conferencing application automatically sets the conference image transmission flag 730 to OFF. If the mobile terminal 100 does not include a camera device, or the camera device is not connected to the mobile terminal 100, the web conference application automatically sets the conference image transmission flag 730 to OFF. The fact that the mobile terminal 100 does not have a camera device or the camera device is not connected to the mobile terminal 100 means that the mobile terminal 100 does not have the camera device when the OS is requested to start the camera application. Alternatively, it can be specified by receiving a response that the camera device is not connected to the mobile terminal 100.

  <Second embodiment>

  Hereinafter, a second embodiment of the present invention will be described with reference to FIGS. 9 and 10. Note that descriptions of processes, screens, and data that are common to the first embodiment are omitted.

  The mobile terminal 100 executes the processing in FIG. 9 immediately after step S602 in FIG.

  In step S901, the mobile terminal 100 obtains acceleration information obtained from the acceleration sensor 212 of the mobile terminal 100 and stored in the memory. The acceleration information referred to here is, for example, the acceleration information 1000 in FIG. The acceleration information 1000 is information in which a history of the acceleration of the mobile terminal 100 is recorded. Here, it is assumed that the acceleration is acquired from the acceleration sensor 212 every 0.1 second and stored.

  In step S902, the mobile terminal 100 determines whether the mobile terminal 100 is moving in the real space. Specifically, when the acceleration (the values of x, y, and z) exceeds a threshold value during the past 0.5 seconds of the acceleration information 1000, it is determined that the mobile terminal is moving. In the present embodiment, the threshold is assumed to be 0.1. The state in which the mobile terminal 100 is moving is assumed to be, for example, a state in which the mobile terminal 100 is held by the user's hand or worn on the user's body.

  On the other hand, when the acceleration (the values of x, y, and z) does not exceed the threshold value during the past 0.5 seconds of the acceleration information 1000, it is determined that the mobile terminal 100 is not moving. The state in which the mobile terminal 100 is not moving (the state in which the mobile terminal 100 is stationary) is, for example, a state in which the mobile terminal 100 is placed on a desk.

  If it is determined that the mobile terminal 100 is not moving, the process ends. If it is determined that the mobile terminal 100 is moving, the process proceeds to step S603 in FIG. 6 and the “still image sharing” button 803 is pressed. Display as possible.

  In the acceleration information 1000 of FIG. 10, the mobile terminal moves when viewed for only 0.2 seconds from 10: 22: 21: 01 on July 26, 2016 to 10: 22: 21: 03 on July 26, 2016. Not in a state. A period of 0.5 seconds from 10: 22: 21: 03 on July 26, 2016 to 10: 22: 21: 08 on July 26, 2016 indicates that the mobile terminal is moving. .

  According to the second embodiment of the present invention, for example, a case where a mobile terminal is installed on a table to capture a moving image of an object, and is acquired and transmitted for the purpose of monitoring the operation of the object, In this case, when the moving image of the user's face is transmitted by the in-camera with the in-camera, it is possible to prevent the start of transmission of a still image due to, for example, an erroneous operation.

  Further, in a case where the mobile terminal is moving and there is a possibility that a camera shake, a focus shift, or the like may occur, a still image can be transmitted as a conference image.

  <Third embodiment>

  Hereinafter, a third embodiment of the present invention will be described with reference to FIGS. Note that descriptions of processes, screens, and data that are common to the first embodiment are omitted.

  In the third embodiment, still image sharing is not performed when the in-camera is used, and still image sharing is enabled when the out-camera is used.

  When using the in-camera, in general, an image of the user using the terminal (for example, a face image) is often taken. If the face image becomes a still image, the voice uttered by the user and the face image do not work together, causing a sense of incongruity. Therefore, it is desirable to avoid sharing the still image. Therefore, in the third embodiment, when the in-camera is used, the “still image sharing” button is not operably displayed (for example, by graying out), thereby preventing the sharing of a still image of the face image. .

  The mobile terminal 100 executes the processing in FIG. 11 immediately after step S602 in FIG.

  In step S1101, the portable terminal 100 reads out the in-camera use flag 1200 stored in the external memory of the portable terminal 100 into the memory and refers to the read out flag.

  The in-camera use flag 1200 = ON indicates that the in-camera is used. The in-camera use flag 1200 = OFF indicates that the out-camera is used. The in-camera use flag 1200 is stored by inserting a value of ON by the web conference application at the time of step S412 in FIG. 4 and then pressing the “in / out switch” button (the in-camera by the camera application). The web conference application is turned off (by switching from to the out-camera). When the “in / out switch” button is pressed with the in-camera use flag 1200 = OFF (by switching from the out-camera to the in-camera by the camera application), the web conference application is turned on. change.

  In step S1102, the mobile terminal 100 determines (specifies) whether the in-camera is in use or the out-camera is in use, terminates the process if the in-camera is in use, and ends the process if the out-camera is in use. The process proceeds to S603, and the “still image sharing” button 803 is displayed so as to be able to be pressed.

  According to the third embodiment of the present invention, still image sharing is not performed when using the in-camera, and still image sharing can be performed when using the out-camera.

  As described above, according to the present invention, it is possible to provide a mechanism that can easily transmit a newly acquired image by using a function already used for image transmission.

  Therefore, a still image can be easily shared during a meeting.

  In the description of the above-described embodiment, when the transmission function is enabled, the “still image sharing” button is displayed so as to be able to be pressed, and when the transmission function is disabled, the “still image sharing” button is displayed so as not to be pressed. However, when the transmission function is invalid, the “still image sharing” button may not be displayed in the first place.

  Further, in the description of the above-described embodiment, whether or not to transmit a still image is determined depending on whether the transmission function is enabled or disabled (displaying a “still image sharing” button causes the still image to be transmitted). Or not). For example, it is determined whether the captured image can be acquired from the camera application, and if the captured image can be acquired, the state of the portable terminal is changed to a state in which the still image can be transmitted. In the case where the captured image cannot be acquired, the state of the mobile terminal may be changed to a state in which still image transmission is not performed. Specifically, instead of step S602 in FIG. 6, it is determined whether or not a captured image has been obtained from the camera application, and if it has been obtained, the process proceeds to step S603. To end. For example, referring to the record of the conference image table 720, when a predetermined number or more (for example, 25 or more) captured images are added to the conference image table 720 during a predetermined time (for example, in the past 5 seconds). It is determined that the captured image has been obtained from the camera application, and when a predetermined number or more (for example, 25 or more) of the captured images have not been added to the conference image table 720, it is determined that the captured image has not been obtained. And Note that this determination method is merely an example, and another determination method may be used.

  By doing so, for example, even when the transmission function of the conference image is temporarily disabled, it is possible to capture a still image and store the still image in the conference image table 720, and when the transmission of the conference image is restarted. Can be used to start transmitting a still image.

  In the description of the above-described embodiment, each screen information is generated by the server 200 and the screen is displayed by the mobile terminal 100 receiving the screen information. In this case, the processing of requesting, generating, and transmitting / receiving each piece of screen information is omitted, and the screen information stored in its own memory is read and displayed on the display screen.

  It should be noted that the present invention is, for example, an embodiment as a system, an apparatus, a method, a program, a storage medium, or the like, and may be specifically applied to a system including a plurality of devices, Alternatively, the present invention may be applied to an apparatus including one device.

  Specifically, the mobile terminal 100 and the server 200 may be integrated, and the processing of each step of the above-described embodiment may be executed as one housing.

  The present invention also includes a software program for realizing the functions of the above-described embodiments, which is supplied directly or remotely to a system or an apparatus. The present invention also includes a case where the present invention is also achieved by a computer of the system or the apparatus reading and executing the supplied program code.

  Therefore, the program code itself installed in the computer to implement the functional processing of the present invention by the computer also implements the present invention. That is, the present invention includes the computer program itself for realizing the functional processing of the present invention.

  Examples of the recording medium for supplying the program include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, an MO, a CD-ROM, a CD-R, and a CD-RW. Further, there are a magnetic tape, a nonvolatile memory card, a ROM, a DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a client computer is connected to a homepage on the Internet using a browser. The computer program itself of the present invention or a compressed file including an automatic installation function can be supplied from the home page by downloading the file to a recording medium such as a hard disk.

  Also, the present invention can be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, the present invention also includes a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and downloaded to a user who satisfies predetermined conditions from a homepage via the Internet to download key information for decryption. Let it. It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer to realize the program.

  The functions of the above-described embodiments are implemented when the computer executes the read program. In addition, the OS or the like running on the computer performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on instructions of the program, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of actual processing, and the functions of the above-described embodiments are also realized by the processing.

It should be noted that the above-described embodiment is merely an example of an embodiment for carrying out the present invention, and the technical scope of the present invention should not be interpreted in a limited manner.
That is, the present invention can be implemented in various forms without departing from the technical idea or the main features.

100A mobile terminal 100B mobile terminal 100C mobile terminal 100D mobile terminal 101 network 200 server

Claims (10)

An information processing device including an imaging device that can communicate with another information processing device including a display unit,
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the other information processing device;
A still image storage control means for controlling to store a still image,
Instruction unit display means for displaying, on a display unit, an instruction unit for controlling storage of a still image by the still image storage control means when the image is transmitted by the transmission means;
In case transmission that is of the image by said transmitting means, said transmitting means, and control means for controlling so as to send the still image stored by the still image storing control means,
Equipped with a,
The still image storage control means, when receiving an operation instruction for instructing section displayed by the instruction unit display means, and characterized that you control so as to store a still image of the image displayed on the display unit Information processing device. The information processing apparatus according to claim 1 , wherein the instruction unit display unit displays the instruction unit on a display unit when the information processing device is moving in a real space. The information processing device includes an in-camera and an out-camera as the imaging device,
The indication unit display unit is configured to display the indication unit without displaying the indication unit when the image captured by the in-camera is transmitted by the transmission unit, and to transmit the image captured by the out-camera. the information processing apparatus according to claim 1 or 2, characterized in that displaying the indication portion for. 2. The apparatus according to claim 1, wherein the control unit stores the still image stored by the still image storage control unit as an image to be transmitted by the transmission unit, and causes the transmission unit to transmit the still image. The information processing apparatus according to any one of claims 3 to 3 . The control means instructs the transmission means to transmit the still image stored by the still image storage control means to the another information processing apparatus, thereby causing the transmission means to transmit the still image. The information processing apparatus according to any one of claims 1 to 4 , wherein A method for controlling an information processing device including an imaging device, which is capable of communicating with another information processing device including a display unit,
A transmitting step of sequentially transmitting an image captured by the image capturing apparatus so as to be sequentially displayed on the other information processing apparatus;
A still image storage control step of controlling to store a still image;
When an image is transmitted by the transmission step, an instruction section display step of displaying an instruction section for performing storage control of a still image by the still image storage control step on a display section,
In case transmission that is of the image by the transmission step, Oite said transmitting step, a control step of controlling so as to send the still image stored by the still image storage control step,
Including
In the still image storage control step, when an operation instruction for the instruction unit displayed in the instruction unit display step is received, control is performed to store a still image of the image displayed on the display unit. A method for controlling an information processing device. A program for controlling an information processing device including an imaging device, which is capable of communicating with another information processing device including a display unit,
The information processing device,
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the other information processing device;
A still image storage control means for controlling to store a still image,
Instruction unit display means for displaying, on a display unit, an instruction unit for controlling storage of a still image by the still image storage control means when the image is transmitted by the transmission means;
Wherein the case transmission that is the image by the transmitting means, said transmitting means, to function as control means for controlling so as to send the still image stored by the still image storing control means,
When the still image storage control unit receives an operation instruction for the instruction unit displayed by the instruction unit display unit, the still image storage control unit functions as a unit that controls to store a still image of the image displayed on the display unit. A program for an information processing device characterized by the following. An information processing system including a plurality of information processing apparatuses including an imaging device,
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
A still image storage control means for controlling to store a still image,
Instruction unit display means for displaying, on a display unit, an instruction unit for controlling storage of a still image by the still image storage control means when the image is transmitted by the transmission means;
In case transmission that is of the image by said transmitting means, said transmitting means, and control means for controlling so as to send the still image stored by the still image storing control means,
Receiving means for sequentially receiving the image transmitted by the transmitting means,
Display means for sequentially displaying the image received by the receiving means on a display unit,
Equipped with a,
The still image storage control means, when receiving an operation instruction for instructing section displayed by the instruction unit display means, and characterized that you control so as to store a still image of the image displayed on the display unit Information processing system. A method for controlling an information processing system including a plurality of information processing apparatuses including an imaging device,
A transmitting step of sequentially transmitting an image captured by the image capturing apparatus to sequentially display the images in the plurality of information processing apparatuses;
A still image storage control step of controlling to store a still image;
When an image is transmitted by the transmission step, an instruction section display step of displaying an instruction section for performing storage control of a still image by the still image storage control step on a display section,
In case transmission that is of the image by the transmission step, Oite said transmitting step, a control step of controlling so as to send the still image stored by the still image storage control step,
A receiving step of sequentially receiving the image transmitted by the transmitting step,
A display step of sequentially displaying the image received by the receiving step on a display unit;
Including
In the still image storage control step, when an operation instruction for the instruction unit displayed in the instruction unit display step is received, control is performed to store a still image of the image displayed on the display unit. A control method for an information processing system. A program for controlling an information processing system including a plurality of information processing apparatuses including an imaging device,
The information processing system,
Transmitting means for sequentially transmitting images picked up by the image pickup device so as to be sequentially displayed on the plurality of information processing devices;
A still image storage control means for controlling to store a still image,
Instruction unit display means for displaying, on a display unit, an instruction unit for controlling storage of a still image by the still image storage control means when the image is transmitted by the transmission means;
In case transmission that is of the image by said transmitting means, said transmitting means, and control means for controlling so as to send the still image stored by the still image storing control means,
Receiving means for sequentially receiving the image transmitted by the transmitting means,
The image received by the receiving means, functioning as a display means for sequentially displaying on a display unit ,
When the still image storage control unit receives an operation instruction for the instruction unit displayed by the instruction unit display unit, the still image storage control unit functions as a unit that controls to store a still image of the image displayed on the display unit. An information processing system program characterized by the following.

Images