JP5488050B2 - Operation control method, operation control program, data processing apparatus, and data processing system - Google Patents

Description

  The present invention relates to an operation control method, an operation control program, a data processing apparatus, and a data processing system for controlling the operation of a data processing apparatus connected to an external device via an interface.

  2. Description of the Related Art Conventionally, a technique for connecting a data processing apparatus that performs various types of data processing to an external device is known in order to reduce the burden of data processing of an external device such as a personal computer (hereinafter referred to as “PC”). For example, in the video conference system described in Patent Document 1, a PC and a data processing device are connected via an interface for transmitting data. The data processing apparatus includes a video encoder that encodes video data input from a camera. The encoding of the video data is performed by a data processing device instead of the PC.

JP-T-2004-506347

  The data processing apparatus can also be operated by electric power supplied from an external device via the interface. If the data processing apparatus can operate only with the power supplied via the interface, other power supply devices such as an AC adapter are unnecessary, and thus the user can easily use the data processing apparatus. However, the amount of power supplied through the interface may be limited. If the data processing apparatus cannot secure the power necessary for executing all executable functions by the interface, the data processing apparatus has to secure the power using another power supply device. Therefore, the data processing apparatus cannot execute an appropriate operation according to an operation condition (for example, supplied power) for executing various processes.

  The present invention provides an operation control method, an operation control program, a data processing device, and a data processing system that allow a data processing device to execute an appropriate operation according to operating conditions for executing various processes. Objective.

An operation control method according to a first aspect of the present invention includes an imaging unit that captures a video, a video encoding unit that encodes video data captured by the imaging unit, and generates input audio as audio data. Voice input means, voice encoding means for encoding voice data input by the voice input means, voice decoding means for decoding encoded voice data, and voice output for outputting voice based on the voice data A data processing apparatus including at least one or more means including the video encoding means as data processing means, and an external device connected to the data processing apparatus by transmission means for transmitting power and data. An operation control method performed in a data processing system provided with information on a power supply source to the data processing device Information acquisition step capable of acquiring power information and external device information generated based on processing performance of the external device, and at least one of the power information and the external device information acquired by the information acquisition step Based on the data processing means, a determination step for determining the data processing means for limiting or prohibiting the operation, and an operation control step for limiting or prohibiting the operation of the data processing means determined by the determination step. The data processing device includes power supply means to which power is supplied from an external power source, and the power information is information indicating whether or not power is supplied to the data processing device by the power supply means. The determination step is acquired when the power information is acquired by the information acquisition step. If the power information is information indicating that power is not supplied by the power supply means, data processing means for restricting or prohibiting the operation is determined, and the external device information indicates the processing performance of the external device. The power information acquired by the information acquisition step indicates that power is not supplied by the power supply means, and the external device information is acquired by the information acquisition step. The determination step further includes determining whether or not the processing performance of the external device indicated by the acquired external device information is equal to or higher than a threshold, and the determining step includes determining that the processing performance is equal to or higher than the threshold. The video encoding means can be determined as the data processing means for prohibiting the operation only when it is determined. The data processing system causes the external device to execute at least data processing executed by the video encoding means when the video encoding means is determined as the data processing means for prohibiting operation by the determining step .

  According to the operation control method according to the first aspect, the data processing device performs an appropriate operation according to at least one of the supplied power and the external device information based on the processing performance of the connected external device. be able to. The data processing apparatus can perform an appropriate operation with less power by limiting the operation of the data processing means and reducing the power consumption. On the other hand, if a sufficient amount of power is used, the data processing apparatus can significantly reduce the processing load on the external device without restricting the operation of the data processing means.

Data processing system, when a sufficient power from the power supply means to the data processing device is not supplied, to limit the operation of the data processing means. As a result, the data processing apparatus can perform an appropriate operation according to the amount of power using only the power supplied by the transmission unit, and can reduce the processing burden on the external device.

  If the processing performance of the external device connected to the data processing device is equal to or greater than the threshold, the data processing system prohibits the processing by the video encoding means included in the data processing device and causes the external device to execute the prohibited processing. be able to. As a result, the data processing apparatus can perform an appropriate operation using only the power supplied by the transmission means. On the other hand, if the processing performance of the external device is lower than the threshold value, the video data is encoded by the data processing device, so that the processing load on the external device is not increased to cause a problem such as processing delay. In other words, the data processing system can more appropriately control the operation of the data processing device according to the processing performance of the external device.

  The operation control method includes: a notification control step for informing a notification means for notifying information of data processing means candidates for restricting or prohibiting operation; and a candidate for data processing means notified by the notification control step. And a reception step of receiving an instruction to select a data processing unit that restricts or prohibits the operation. The determining step may determine the data processing means selected by the selection instruction received by the receiving step as the data processing means for restricting or prohibiting the operation. The user can select a data processing means for which processing is restricted in consideration of a problem that may occur due to data processing being restricted. Therefore, the data processing system can reduce the possibility of a problem that the user does not allow.

In the operation control method, when the power information acquired in the information acquisition step indicates that power is not supplied by the power supply unit, candidates for data processing units that restrict or prohibit operations are A notifying control step for notifying the notifying means for notifying, and a receiving step for receiving an instruction to select a data processing means for restricting or prohibiting the operation from the candidates for the data processing means notified by the notifying control step. You may prepare. The notification control step notifies the video encoding means as a candidate of a data processing means for prohibiting an operation only when the determination step determines that the processing performance of the external device is equal to or higher than a threshold value. Good. It said determining step, the data processing means selected by the accepted et a selection instruction by said reception step, may be determined as a data processing means for limiting or prohibiting the operation.

  The user can select a data processing means for which processing is restricted in consideration of a problem that may occur due to data processing being restricted. Therefore, the data processing system can reduce the possibility of a problem that the user does not allow. Only when the processing performance of the external device is equal to or higher than the threshold value, the user can select that the external device, not the data processing device, execute the process of encoding video data. If an external device executes processing to encode video data, the processing load on the external device increases, but the power consumption of the data processing device is greatly reduced, so processing other than video data encoding is greatly reduced. There is no need to limit. On the other hand, if the user does not want to increase the processing load on the external device, the user need not prohibit the operation of the video encoding means of the data processing apparatus. Therefore, the data processing system can notify the user of appropriate selection candidates according to the processing performance of the external device, and can perform processing more suitable for the user's request.

The operation control program according to the second aspect of the present invention generates an image pickup means for picking up an image, a video encoding means for encoding video data picked up by the image pickup means, and an input sound as sound data. Voice input means, voice encoding means for encoding voice data input by the voice input means, voice decoding means for decoding encoded voice data, and voice output for outputting voice based on the voice data An operation control program that is executed by a computer of a data processing apparatus connected to an external device by means of transmission means for transmitting power and data, comprising at least one means including at least the video encoding means as data processing means. a is, power power information is information about the source of the previous SL data processing apparatus, and the external device The data processing based on at least one of the information acquisition step capable of acquiring the external device information generated based on the processing performance of the information, the power information acquired by the information acquisition step, and the external device information Of the means, a determination step for determining a data processing means for restricting or prohibiting an operation, and an operation control step for restricting or prohibiting the operation of the data processing means determined by the determination step , the data processing device includes: Power supply means to which power is supplied from an external power source, and the power information is information indicating whether or not power is supplied to the data processing device by the power supply means, and the determining step includes the information When the power information is acquired by the acquiring step, the acquired power information is the power If it is information indicating that power is not supplied by the power supply means, data processing means for restricting or prohibiting the operation is determined, and the external device information is information indicating the processing performance of the external device, and the information The external device information acquired when the power information acquired in the acquisition step indicates that power is not supplied by the power supply means and the external device information is acquired in the information acquisition step. Further comprising a determination step for determining whether or not the processing performance of the external device indicated by is greater than or equal to a threshold value, and the determination step operates only when the determination step determines that the processing performance is equal to or greater than the threshold value. It is possible to determine the video encoding means as data processing means for prohibiting the above .

  According to the operation control program according to the second aspect, the data processing device performs an appropriate operation according to at least one of the supplied power and the external device information based on the processing performance of the connected external device. be able to. The data processing apparatus can perform an appropriate operation with less power by limiting the operation of the data processing means and reducing the power consumption. On the other hand, if a sufficient amount of power is used, the data processing apparatus can significantly reduce the processing load on the external device without restricting the operation of the data processing means.

A data processing apparatus according to a third aspect of the present invention includes an imaging unit that captures a video, a video encoding unit that encodes video data captured by the imaging unit, and generates input audio as audio data. Voice input means, voice encoding means for encoding voice data input by the voice input means, voice decoding means for decoding encoded voice data, and voice output for outputting voice based on the voice data A data processing apparatus comprising at least one means including at least the video encoding means as data processing means, and connected to an external device by transmission means for transmitting power and data, wherein the data processing apparatus Power information, which is information about the power supply source to the device, and external device information generated based on the processing performance of the external device. Possible data acquisition means, and data processing means for restricting or prohibiting operation of the data processing means based on at least one of the power information and the external device information acquired by the information acquisition means. Determining means for determining, operation control means for restricting or prohibiting the operation of the data processing means determined by the determining means, and power supply means to which power is supplied from an external power source, wherein the power information includes the power Information indicating whether or not power is supplied to the data processing apparatus by a supply means, and the determination means, when the power information is acquired by the information acquisition means, the acquired power information Data processing means for restricting or prohibiting the operation if the information indicates that no power is supplied by the power supply means The external device information is information indicating processing performance of the external device, the power information acquired by the information acquisition unit indicates that power is not supplied by the power supply unit, and The determination unit further includes a determination unit that determines whether or not the processing performance of the external device indicated by the acquired external device information is equal to or higher than a threshold when the external device information is acquired by the information acquisition unit. The means can determine the video encoding means as the data processing means for prohibiting the operation only when the determination means determines that the processing performance is equal to or higher than the threshold value .

  The data processing device according to the third aspect can perform an appropriate operation according to at least one of the supplied power and the external device information based on the processing performance of the connected external device. The data processing apparatus can perform an appropriate operation with less power by limiting the operation of the data processing means and reducing the power consumption. On the other hand, if a sufficient amount of power is used, the data processing apparatus can significantly reduce the processing load on the external device without restricting the operation of the data processing means.

  According to a fourth aspect of the present invention, there is provided a data processing system, an imaging unit for imaging video, a video encoding unit for encoding video data captured by the imaging unit, and generating input audio as audio data. Voice input means, voice encoding means for encoding voice data input by the voice input means, voice decoding means for decoding encoded voice data, and voice output for outputting voice based on the voice data A data processing apparatus including at least one or more means including the video encoding means as data processing means, and an external device connected to the data processing apparatus by transmission means for transmitting power and data. A data processing system comprising: a power supply means for supplying power to the data processing device from an external power supply; and the data processing system. In the apparatus, the power information acquisition means for acquiring power information, which is information indicating whether or not power is supplied to the data processing apparatus by the power supply means, and the operation of the data processing means in the external device. A data processing unit that restricts or prohibits the data processing unit based on processing performance of the external device, and in the data processing apparatus, the power information acquired by the power information acquisition unit is transmitted by the power supply unit. And operation control means for restricting or prohibiting the operation of the data processing apparatus selected by the selection means when the information indicates that power is not supplied. According to the data processing system of the fourth aspect, the data processing apparatus can perform an appropriate operation according to the supplied power and the processing performance of the connected external device.

1 is a diagram illustrating a system configuration of a video conference system 101 including a data processing system 100. FIG. It is a block diagram which shows the electrical structure of the data processor 1 and PC3. It is a flowchart of the operation mode determination process which the data processor 1 performs. It is a figure which shows the display which displayed the 1st selection candidate display screen which contains PC encoding mode in a selection candidate. It is explanatory drawing for demonstrating an example of the content of the data processing performed when each operation mode is performed. It is a flowchart of the operation mode determination process which the data processor 1 which concerns on a modification performs. It is a flowchart of the starting process which PC3 which concerns on a modified example performs.

  Hereinafter, a data processing system 100 according to the present invention, and a data processing device 1 and a PC 3 included in the data processing system 100 will be described with reference to the drawings. The drawings to be referred to are used for explaining technical features that can be adopted by the present invention. The configuration of the apparatus, the flowcharts of various processes, and the like described in the drawings are not intended to be limited to these, but are merely illustrative examples.

  The system configuration of the data processing system 100 will be described with reference to FIG. The data processing system 100 includes a data processing device 1 and a PC 3. The data processing device 1 and the PC 3 are connected by a USB (Universal Serial Bus) cable 27 (see FIG. 2). The PC 3 can communicate with other PCs 3 via the network 8 such as the Internet.

  In the present embodiment, the video conference system 101 is configured by connecting the PCs 3 included in each of the data processing systems 100 to each other. In the video conference system 101, each data processing system 100 encodes audio data input by a microphone and video data input by a camera. Each PC 3 transmits the encoded data to the other PC 3 via the network 8, whereby the data is shared among the plurality of PCs 3. Each data processing system 100 displays a video on the display 36 based on the data received from the other data processing system 100 and generates a sound on the speakers 18 and 39 (see FIG. 2), thereby performing a remote conference. Can be executed. Note that the video conference system 101 may partially include the PC 3 that is not connected to the data processing device 1. If the PC 3 is not connected to the data processing device 1, all processing such as data encoding may be performed by itself. The data processing system 100 can also execute a remote conference by outputting only one of audio and video.

  The data processing apparatus 1 will be described. The data processing apparatus 1 is a dedicated I / O terminal for executing a remote conference in the video conference system 101. As described above, in the video conference system 101, audio data and video data are encoded and decoded. As a result, the video conference system 101 transmits and receives data smoothly. However, the processing load for decoding video data is particularly large. When the CPU 30 (see FIG. 2) of the PC 3 executes all the processing such as decoding of video data, an excessive load is applied to the CPU 30 and there is a possibility that problems such as processing delay occur. The data processing apparatus 1 can perform processing such as video data encoding, audio data encoding, audio data decoding, and audio output. When the data processing device 1 performs processing such as encoding of video data, it is possible to reduce the load on the CPU 30 of the PC 3 and reduce the possibility of problems such as processing delay.

  With reference to FIG. 2, the electrical configuration of the data processing device 1 and the PC 3 will be described. The data processing device 1 includes a CPU 10 that controls the data processing device 1. A RAM 11, a flash ROM 12, a video encoder 13, an audio decoder 15, an audio encoder 17, and a USB interface 20 are connected to the CPU 10. An echo canceller 16 is connected to the audio decoder 15 and the audio encoder 17. Further, the data processing apparatus 1 includes a camera 14, a speaker 18, a microphone 19, and a power supply circuit 22.

  The RAM 11 temporarily stores various information. The flash ROM 12 is a non-volatile storage device that stores various information such as a program for operating the data processing device 1. The video encoder 13 is a DSP (Digital Signal Processor) for encoding video data input from a camera that captures video (for example, the camera 14). The DSP is a dedicated microprocessor for performing specific digital signal processing. The audio decoder 15 is a DSP for decoding encoded audio data. The audio encoder 17 is a DSP for encoding audio data input from a microphone (for example, a microphone 19) that inputs audio. The echo canceller 16 is an integrated circuit (IC) for removing echoes (echoes) generated when the sound output from the speaker is input to the microphone. The USB interface 20 is connected to the USB cable 27. The power supply circuit 22 supplies power from the external power supply to the data processing device 1 via the AC adapter 23.

  The PC 3 includes a CPU 30 that controls the PC 3. A RAM 31, ROM 32, HDD 33, and input / output interface 40 are connected to the CPU 30. The RAM 11 temporarily stores various information. The ROM 32 stores a control program, initial values, and the like. The HDD 33 is a non-volatile storage device that stores various types of information. The CPU 30 can execute the same process as the process executed by the data processing device 1. Specifically, the CPU 30 can execute a process for encoding video data, a process for decoding encoded audio data, a process for encoding audio data, a process for generating sound on the speaker 39, and the like.

  Connected to the input / output interface 40 are a USB interface 34, an external communication interface (I / F) 35, a display 36, a microphone 37, a camera 38, and a speaker 39. The USB interface 34 is connected to the USB cable 27. The external communication interface 35 connects the PC 3 to the network 8. The display 36 displays an image. The microphone 37 inputs sound. The camera 38 captures an image and inputs the image data to the PC 3. The speaker 39 outputs sound.

  The USB cable 27 that connects the data processing apparatus 1 and the PC 3 can transmit not only data but also power. Therefore, the data processing apparatus 1 can operate with the power supplied via the USB cable 27 even when the power is not supplied via the power supply circuit 22. However, the amount of power that can be supplied to the data processing device 1 via the USB cable 27 is limited. The data processing apparatus 1 can execute a plurality of data processes such as data encoding, but requires a large amount of power when executing all of the plurality of data processes. Therefore, the data processing apparatus 1 cannot execute all data processing with only the power supplied via the USB cable 27 without restricting or prohibiting the processing operation. According to the data processing system 100 of the present embodiment, the data processing apparatus 1 can perform an appropriate operation according to at least one of the supplied power and the processing performance of the PC 3. Hereinafter, processing performed in the data processing system 100 will be described in detail.

  With reference to FIG. 3, the operation mode determination process which the data processing apparatus 1 performs is demonstrated. The operation mode determination process is executed by the CPU 10 in accordance with a program stored in the flash ROM 12 when an operation for starting the operation of the data processing apparatus 1 is performed by the user.

  First, processing is started in the power saving mode (S1). The power saving mode is a mode that can be operated only by the power supplied via the USB cable 27. The data processor 1 is not always supplied with power by the AC adapter 23. Therefore, the data processing device 1 can be reliably started even when there is no power supply by the AC adapter 23 by starting in the power saving mode. Next, power information is acquired (S2). The power information is information indicating whether or not power is being supplied to the data processing device 1 by the AC adapter 23, and is acquired from the state of the power supply circuit 22.

  Based on the acquired power information, it is determined whether or not power is being supplied by the AC adapter 23 (S3). If power is supplied by the AC adapter 23 (S3: YES), the data processing device 1 can execute all of the plurality of executable data processes without restricting or prohibiting the operation. Accordingly, the operation mode to be executed is determined to be the normal mode (S4). The normal mode is an operation mode in which all of a plurality of data processes that can be executed by the data processing apparatus are executed. Details thereof will be described later with reference to FIG. The PC 3 is notified that the operation mode has been determined to be the normal mode (S5), and the operation mode determination process ends.

  If power is not supplied by the AC adapter 23 (S3: NO), performance information indicating the processing performance of the PC 3 is acquired from the PC 3 (S6). In the present embodiment, the performance information is the number of clocks of the CPU 30 of the PC 3. However, information indicating memory capacity, multitask performance, etc. may be used as performance information together with the CPU clock number or separately from the CPU clock number.

  Next, a process for causing the user to select an operation mode is performed. First, it is determined whether or not the processing performance of the PC 3 indicated by the acquired performance information is equal to or higher than a threshold value (S7). If it is equal to or greater than the threshold (S7: YES), an instruction to display the first selection candidate display screen on the display 36 is given to the PC 3 (S8). If the processing performance of the PC 3 is lower than the threshold (S7: NO), an instruction to display the second selection candidate display screen on the display 36 is given to the PC 3 (S9).

  FIG. 4 shows the display 36 displaying the first selection candidate display screen. The selection candidate display screen is a screen for notifying the user of operation mode candidates that can be selected by the user. A user operates a mouse (not shown) or the like connected to the PC 3 and inputs an instruction to select one of the selection candidates displayed on the display 36 to select a desired operation mode. Can do.

  As shown in FIG. 4, in the first selection candidate display screen, the PC encoding mode is included in the selection candidates of the plurality of operation modes. On the other hand, although not shown, the second selection candidate display screen is the same as the first selection candidate display screen except that the PC encoding mode is not a selection candidate.

  The PC encoding mode is an operation mode in which the power consumed by the data processing device 1 is reduced by causing the PC 3 to execute the video data encoding process instead of the data processing device 1. As described above, since the processing load for executing the encoding process of the video data is large, a large amount of power is required. Therefore, if the PC 3 executes the video data encoding process, the data processing apparatus 1 can operate only with the power supplied via the USB cable 27 without restricting or prohibiting other data processing. it can. However, if the data processing performance of the PC 3 is low, there is a high possibility that problems such as a decrease in the processing speed of the PC 3 will occur by causing the PC 3 to execute the video data encoding process.

  In the operation mode determination process, an instruction to display the first selection candidate display screen capable of selecting the PC encoding mode on the display 36 is performed only when the processing performance of the PC 3 is equal to or higher than the threshold. If the processing performance of the PC 3 is high, it is unlikely that an excessive burden will be placed on the PC 3 even if the PC encoding mode is selected by the user, and it is not necessary for the user to allow a reduction in audio and video quality. Furthermore, if the processing performance of the PC 3 is low, the data processing system 100 prevents the PC 3 from being overloaded by selecting the PC encoding mode. In other words, the data processing system 100 can more appropriately control the operation of the data processing device 1 according to the processing performance of the PC 3. Details of the other operation modes will be described later with reference to FIG.

  Returning to the description of FIG. When the instruction to display the selection candidate display screen is completed (S8, S9), it is determined whether or not mode designation information is input from the PC 3 (S10). Until the mode designation information is input (S10: NO), the standby state is maintained. When the PC 3 displays the selection candidate display screen on the display 36, the PC 3 accepts an operation mode selection instruction from the user. When receiving the selection instruction, the PC 3 determines the operation mode selected by the selection instruction as the operation mode executed by the data processing system 100. The PC 3 transmits operation mode specifying information for specifying the determined operation mode to the data processing device 1. In the operation mode determination process, when operation mode designation information is input from the PC 3 (S10: YES), the operation mode specified by the input information is determined as the operation mode executed by the data processing system 100. (S11). In accordance with the determined operation mode, at least one of a plurality of data processes that can be executed in the data processing apparatus 1 is restricted or prohibited (S12). Details of this will be described later with reference to FIG. Thereafter, the operation mode determination process ends.

  With reference to FIG. 5, the operation modes that can be executed by the data processing system 100 will be described. FIG. 5 shows an example of the contents of data processing performed when each operation mode is executed. In the figure, “I / O” indicates that the data processing apparatus 1 executes processing, and “PC” indicates that the PC 3 executes processing. In the data processing system 100 according to the present embodiment, data processing that can be executed by both the data processing device 1 and the PC 3 includes video encoding, audio encoding, audio decoding, echo removal, camera video input, speaker audio output, and There is microphone audio input. In the data processing system 100, each data processing is executed by either the data processing device 1 or the PC 3 according to the operation mode to be executed.

  “Video encoding” is a process of encoding video data input by the camera 14 of the data processing apparatus 1 or the camera 38 connected to the PC 3. “Voice coding” is a process of coding voice data input by the microphone 19 of the data processing apparatus 1 or the microphone 37 connected to the PC 3. “Voice decoding” is a process of decoding encoded voice data of another base. “Echo removal” is a process for removing an echo. “Camera video input” is a process of inputting video data by causing the camera 14 of the data processing apparatus 1 or the camera 38 connected to the PC 3 to capture an image. “Speaker audio output” is a process for outputting audio to the speaker 18 of the data processing apparatus 1 or the speaker 39 connected to the PC 3 based on the decoded audio data. “Microphone voice input” is a process of operating the microphone 19 of the data processing apparatus 1 or the microphone 37 connected to the PC 3 to input voice data. In the present embodiment, the PC 3 always executes the process of decoding the video data of another base and displaying it on the display 36. However, the data processing apparatus 1 may be caused to execute processing for decoding video data.

  The normal mode is executed when power is supplied to the data processing device 1 via the AC adapter 23. In the normal mode, all data processing is performed by the data processing device 1. As a result, the video conference can be executed smoothly while reducing the processing load on the PC 3.

  Even in the volume restriction mode, all data processing is performed by the data processing device 1 as in the normal mode. However, the maximum sound volume output by the speaker 18 is limited. As a result, the power consumed by the speaker 18 is reduced. Therefore, the data processing apparatus 1 operates only with the power supplied via the USB cable 27 and can reduce the processing load on the PC 3. The data processing device 1 notifies the user that it is in the volume limit mode by changing the lighting mode of an LED (not shown) indicating that the maximum volume has been reached. Further, when executing the volume restriction mode, the PC 3 transmits a request instruction to increase the gain of the microphone (a ratio for amplifying the electric signal) to the other PC 3 in the video conference system 101. As a result, the data processing device 1 can cause the speaker 18 to output sound that can be easily heard by the user. The user can clearly hear the voices of other bases even in the volume restriction mode in which the maximum volume is restricted.

  Even in the bass cut mode, all data processing is performed by the data processing device 1. However, the low frequency range of the sound output by the speaker 18 is cut. As a result, the power consumed by the speaker 18 is reduced. If the user can tolerate a decrease in voice quality due to the cut of the low frequency range, the user may select the low frequency cut mode.

  In the PC speaker mode, the PC 3 causes the speaker 39 to generate sound based on the sound data decoded by the sound decoder 15 of the data processing device 1. As a result, the data processing apparatus 1 can reduce all of the power consumed by the speaker 18. If the performance of the speaker 39 connected to the PC 3 is high, the volume and quality of the output audio will not decrease. Therefore, the user may determine whether to select the PC speaker mode in consideration of the performance of the speaker 39.

  The audio conference mode is a mode in which transmission of video data to another PC 3 in the video conference system 101 is stopped. The data processing apparatus 1 can reduce the power consumed by the camera 14. Furthermore, since the data processing apparatus 1 can lower the clock frequency of the DSP in the apparatus, power consumption can be greatly reduced. When executing the audio conference mode, the PC 3 notifies the other PCs 3 in the video conference system 101 that video data is not transmitted.

  In the image resolution restriction mode, all data processing is performed by the data processing apparatus 1, but the image resolution is lowered. By reducing the resolution of the image, the amount of calculation processing executed by the video encoder 13 is reduced. Therefore, the data processing device 1 can lower the clock frequency of the DSP and reduce power consumption. In the image resolution restriction mode, the fineness of the image is lowered, but the frame rate of the video is not lowered, and the smoothness of the motion of the video is not lowered. When executing the image resolution restriction mode, the PC 3 notifies the other PC 3 that the video data is transmitted with the image resolution lowered.

  In the frame rate restriction mode, unlike the image resolution restriction mode, the frame rate of the video is lowered without lowering the resolution of the image. By reducing the frame rate, the amount of calculation processing executed by the video encoder 13 is reduced, and the power consumption of the data processing apparatus 1 is reduced. The smoothness of the motion of the image is reduced, but the definition of the image is not reduced. When executing the frame rate limiting mode, the PC 3 notifies the other PC 3 that the video data is to be transmitted at a reduced frame rate.

  In the PC encode mode, as described above, only the video data input from the camera 14 or the camera 38 is encoded by the PC 3. Since the data processing apparatus 1 can stop the encoding process by the video encoder 13, the power consumption can be reduced. Since the PC encoding mode is not selected unless the data processing performance of the PC 3 is equal to or higher than the threshold value, an excessive load is imposed on the PC 3 and a problem such as processing delay does not occur.

  When the user does not connect the AC adapter 23 to the data processing device 1, the user selects the operation mode from the operation modes other than the normal data mode in consideration of problems that may occur due to data processing restrictions. can do. That is, the data processing system 100 can reduce the processing load on the PC 3 by operating the data processing apparatus 1 with the power supplied by the USB cable 27 without causing a problem that the user does not allow. The user can select a method of connecting the AC adapter 23 to the data processing device 1 when the selection candidate display screen (see FIG. 4) is not allowed and any data processing restriction is not allowed.

  As described above, according to the data processing system 100 according to the present embodiment, the data processing device 1 operates appropriately according to at least one of the supplied power and the processing performance of the connected PC 3. It can be performed. The data processing apparatus 1 can operate with less power by limiting or prohibiting various types of executable data processing to reduce power consumption. If sufficient power is used, the data processing apparatus 1 can significantly reduce the processing load on the PC 3 without restricting data processing.

  Specifically, the data processing apparatus 1 can restrict or prohibit data processing that can be executed by itself when sufficient power is not supplied by the AC adapter 23. As a result, the data processing apparatus 1 can perform an appropriate operation using only the power supplied by the USB cable 27, and can reduce the processing load on the PC 3.

  The data processing system 100 prohibits the encoding processing of the video data by the data processing device 1 only when the processing performance of the PC 3 connected to the data processing device 1 is equal to or higher than the threshold, and performs the prohibited encoding processing. It can be executed by the PC 3. As a result, the data processing apparatus 1 can perform an appropriate operation using only supplied power. On the other hand, if the processing performance of the PC 3 is lower than the threshold value, the data processing apparatus 1 performs the video data encoding process, so that the processing load on the PC 3 is not increased and a problem such as processing delay does not occur. In other words, the data processing system 100 can more appropriately control the operation of the data processing device 1 according to the processing performance of the PC 3.

  The data processing system 100 notifies the user of processing candidates to be restricted or prohibited from among the processes that can be executed by the data processing apparatus 1 through the display 36. The user can select a process to be restricted or prohibited in consideration of a problem that may be caused by the process being restricted or prohibited. Therefore, the data processing system 100 can cause the data processing apparatus 1 to execute an appropriate operation according to the operation condition without causing a problem that the user does not allow. Only when the processing performance of the PC 3 is equal to or higher than the threshold value, the user can select that the PC 3, not the data processing apparatus 1, perform the video data encoding process. When the video data encoding process is executed by the PC 3, the processing load on the PC 3 increases, but it is not necessary to limit other processes. On the other hand, if the user does not want to increase the processing load on the PC 3, the user may not prohibit the video data encoding process by the data processing device 1. Therefore, the data processing system 100 notifies the user of an appropriate selection candidate according to the processing performance of the PC 3, and selects data processing that restricts the operation from the notified selection candidate, thereby making it more suitable for the user's request. Processing can be performed.

  In the above embodiment, the camera 14 corresponds to the “imaging means” of the present invention. The video encoder 13 corresponds to “video encoding means”. The microphone 19 corresponds to “voice input means”. The voice encoder 17 corresponds to “voice coding means”. The audio decoder 15 corresponds to “audio decoding means”. The speaker 18 corresponds to “audio output means”. The USB cable 27 corresponds to “transmission means”. The PC 3 corresponds to an “external device”. The performance information indicating the processing performance of the PC 3 corresponds to “external device information”. The process of acquiring the performance information of the PC 3 in S6 of FIG. 3 corresponds to an “information acquisition step”. The process of determining the operation mode in S3 to S11 in FIG. 3 corresponds to a “determination step”. The process of restricting or prohibiting data processing by the data processing apparatus 1 in S12 of FIG. 3 corresponds to an “operation control step”.

  The AC adapter 23 corresponds to the “power supply means” of the present invention. The process of determining whether or not the processing performance of the PC 3 is equal to or higher than the threshold in S7 of FIG. 3 corresponds to a “determination step”. The process of outputting a selection candidate display screen display instruction in S8 and S9 in FIG. 3 corresponds to a “notification control step”. The process of inputting the operation mode designation information output as a result of accepting the selection instruction by the user in S10 of FIG. 3 corresponds to a “reception step”.

  The CPU 10 that acquires the performance information of the PC 3 in S6 of FIG. 3 functions as an “information acquisition unit”. The CPU 10 that determines the operation mode in S3 to S11 in FIG. 3 functions as a “determination unit”. The CPU 10 that restricts or prohibits data processing by the data processing apparatus 1 in S12 of FIG. 3 functions as an “operation control unit”.

  It goes without saying that the present invention is not limited to the above-described embodiment, and various modifications are possible. Hereinafter, a modification of the above embodiment will be described with reference to FIG. 6 and FIG. In the modification shown in FIGS. 6 and 7, the data processing device 1 determines whether to restrict or prohibit data processing by the data processing device 1. On the other hand, the PC 3 determines whether or not the PC encoding mode can be selected. In the following modified example, the same configurations and processes as those of the above-described embodiment are denoted by the same reference numerals, and description thereof is omitted or simplified.

  With reference to FIG. 6, the operation mode determination process which the data processing apparatus 1 which concerns on a modification performs is demonstrated. The CPU 10 of the data processing device 1 executes an operation mode determination process when an operation for starting the operation of the data processing device 1 is performed by the user. First, processing is started in the power saving mode (S1). Information (power information) indicating whether or not power is being supplied by the AC adapter 23 is acquired (S2). Based on the power information, it is determined whether power is being supplied by the AC adapter 23 (S3). If it has been performed (S3: YES), the operation mode to be executed is determined to be the normal mode (S4). The PC 3 is notified that the normal mode is to be executed (S5), and the operation mode determination process ends.

  If power is not supplied by the AC adapter 23 (S3: NO), an operation mode selection request is transmitted to the PC 3 (S21). The operation mode selection request is a request for selecting one of the operation modes other than the normal mode as an operation mode to be executed. As will be described later, when receiving the operation mode selection request, the PC 3 determines the operation mode to be executed according to its own processing performance and the operation by the user, and stores operation mode designation information for designating the decided operation mode as data. Transmit to the processing device 1. In the operation mode determination process, the process waits until the operation mode designation information is inputted from the PC 3 (S22: NO). When the operation mode designation information is inputted (S22: YES), the operation mode designated from the PC 3 is The operation mode to be executed is determined (S23). In accordance with the determined operation mode, at least one of a plurality of data processes that can be executed in the data processing apparatus 1 is restricted or prohibited (S24). The operation mode determination process ends.

  With reference to FIG. 7, the starting process which PC3 which concerns on a modification is performed is demonstrated. The activation process is a process performed when an application for executing a video conference is activated. When the application activation instruction is input by the user, the CPU 30 of the PC 3 executes the activation process shown in FIG. 7 according to the program stored in the HDD 33.

  First, an application for executing a video conference is activated (S31). It is determined whether or not a notification for executing the normal mode has been issued from the data processing apparatus 1 (S32). If notification has not been made (S32: NO), it is determined whether or not an operation mode selection request has been made (S33). If an operation mode selection request has not been made (S33: NO), the determinations of S32 and S33 are repeated. When the notification for executing the normal mode is given (S32: YES), the normal mode is selected as the operation mode to be executed (S34). That is, the PC 3 causes the data processing device 1 to execute a plurality of processes such as video encoding without executing itself. Thereafter, the activation process ends.

  When an operation mode selection request is made from the data processing device 1 (S33: YES), performance information indicating the processing performance of the PC 3 itself is acquired (S36). It is determined whether or not the acquired processing performance is equal to or higher than a threshold value (S37). If it is equal to or greater than the threshold (S37: YES), a first selection candidate display screen (see FIG. 4) capable of selecting the PC encoding mode is displayed on the display 36 (S38). If the processing performance is lower than the threshold (S37: NO), a second selection candidate display screen in which the PC encoding mode cannot be selected is displayed (S39).

  It is determined whether or not the user has selected an operation mode (S40). It will be in a standby state until selection operation is performed (S40: NO). When the selection operation is performed (S40: YES), the selected operation mode is determined as the operation mode to be executed (S41). In S41, when the operation mode is determined, the PC 3 controls which process is executed in the PC 3 in accordance with the determined operation mode. Operation mode designation information for designating the determined operation mode is transmitted to the data processing apparatus 1 (S42). If there is information (for example, a request for improvement of microphone gain, etc., see FIG. 5) to be notified to another PC 3 (PC 3 of the communication partner) in the video conference system 101, the information is notified via the network 8. (S43). The startup process ends.

  As described above, the PC 3 may determine whether or not the PC encoding mode can be selected. That is, it is not necessary for the data processing apparatus 1 to execute all the processes for determining the operation mode. In the above modification, the operation mode designation information that is information generated based on the processing performance of the PC 3 corresponds to “external device information” of the present invention. The CPU 10 that determines the operation mode in S4 and S23 of FIG. 6 functions as a “determination unit”. The CPU 10 that restricts or prohibits the process in S24 of FIG. 6 functions as an “operation control unit”. CPU10 which acquires electric power information by S2 of FIG. 6 functions as "electric power information acquisition means." The CPU 30 that selects the operation mode in S36 to S41 in FIG. 7 functions as a “selection unit”. The CPU 30 that restricts or prohibits the operation of the data processing apparatus 1 in S42 and S43 in FIG. 7 functions as an “operation control unit”.

  Other variations of the above embodiment are possible. For example, the PC 3 may perform all the processing for determining the operation mode. In this case, the PC 3 acquires power information from the data processing device 1 after starting the application (S31) in the start processing (see FIG. 7). As described above, the power information is information indicating whether power is being supplied to the data processing device 1 via the AC adapter 23. If power is supplied from the AC adapter 23, the process may proceed to S34. If power is not supplied by the AC adapter 23, the process may proceed to S36.

  The plurality of operation modes shown in FIG. 5 are merely examples. Of course, an operation mode other than the operation mode shown in FIG. 5 may be executed. For example, the data processing apparatus 1 may execute only the operations of the camera 14, the speaker 18, and the microphone 19, and cause the PC 3 to perform all the data encoding and decoding processes. By causing the PC 3 to perform all the data encoding and decoding processes, the power consumption of the data processing apparatus 1 can be reduced. Therefore, the data processing device 1 can operate using only the power supplied via the USB cable 27. The data processing system 100 of the above embodiment executes only one of a plurality of operation modes. However, two or more operation modes may be executed simultaneously.

  In the above embodiment, power information indicating whether or not power is being supplied to the data processing device 1 by the AC adapter 23, and external device information generated based on the processing performance of the PC 3 (in detail, The operation mode is determined based on the performance information or the operation mode designation information. However, the data processing system 100 may determine the operation mode using only one of the power information and the external device information. For example, the predetermined operation mode may be executed when it is determined from the power information that power is not being supplied by the AC adapter 23.

  In the above embodiment, the PC 3 is used as an external device connected to the data processing apparatus 1, but other devices (for example, a portable terminal equipped with a display device) other than the PC are used as the external device. Needless to say, you can. The connection of the data processing apparatus 1 and the external device is not limited to the USB cable 27. Any transmission means capable of transmitting power and data can be used in place of the USB cable 27. The data processing system 100 of the above embodiment notifies the user of operation mode selection candidates via the display 36. However, the selection candidate may be notified using voice or the like.

1 Data processing device 3 PC
10 CPU
12 Flash ROM
13 Video encoder 14 Camera 15 Audio decoder 17 Audio encoder 18 Speaker 19 Microphone 23 AC adapter 27 USB cable 30 CPU
33 HDD
36 display 37 microphone 38 camera 39 speaker 100 data processing system

Claims (6)

Imaging means for imaging video, video encoding means for encoding video data captured by the imaging means, audio input means for generating input audio as audio data, audio data input by the audio input means 1 or 2 including at least the video encoding means among audio encoding means for encoding audio, audio decoding means for decoding encoded audio data, and audio output means for outputting audio based on audio data An operation control method performed in a data processing system including a data processing apparatus including a plurality of means as data processing means and an external device connected to the data processing apparatus by transmission means for transmitting power and data. ,
Information acquisition step capable of acquiring power information, which is information about a power supply source to the data processing device, and external device information generated based on processing performance of the external device;
A determination step of determining a data processing means for restricting or prohibiting an operation among the data processing means, based on at least one of the power information and the external device information acquired by the information acquisition step;
An operation control step for restricting or prohibiting the operation of the data processing means determined by the determining step , and
The data processing apparatus includes a power supply unit that is supplied with power from an external power source,
The power information is information indicating whether power is supplied to the data processing device by the power supply means,
In the determination step, when the power information is acquired by the information acquisition step, if the acquired power information is information indicating that power is not supplied by the power supply means, the operation is limited or Decide the data processing means to prohibit,
The external device information is information indicating the processing performance of the external device,
The external information acquired when the power information acquired by the information acquisition step indicates that power is not supplied by the power supply means and the external device information is acquired by the information acquisition step. A determination step of determining whether or not the processing performance of the external device indicated by the device information is equal to or higher than a threshold;
The determining step can determine the video encoding means as a data processing means for prohibiting the operation only when the determination step determines that the processing performance is equal to or higher than a threshold value,
The data processing system causes the external device to execute at least data processing executed by the video encoding unit when the video encoding unit is determined as the data processing unit for prohibiting operation by the determining step. A characteristic operation control method. A notification control step for informing a notification means for informing information on candidates for data processing means for restricting or prohibiting operation; and
A reception step of receiving an instruction to select a data processing unit that restricts or prohibits the operation from candidates of the data processing unit notified by the notification control step;
2. The operation control method according to claim 1, wherein the determining step determines the data processing means selected by the selection instruction received by the receiving step as a data processing means for restricting or prohibiting the operation. . When the power information acquired in the information acquisition step indicates that power is not supplied by the power supply unit, a candidate for a data processing unit that restricts or prohibits an operation is notified to a notification unit that notifies the information. A notification control step for informing;
A reception step of receiving an instruction to select a data processing unit that restricts or prohibits the operation from candidates of the data processing unit notified by the notification control step;
In the notification control step, only when the processing performance of the external device is determined to be greater than or equal to a threshold value by the determination step, the video encoding unit is notified as a candidate of a data processing unit that prohibits operation,
Said determining step, the operation control method according to claim 1, wherein the determining the data processing means selected by the selection instruction accepted et a by said accepting step, as a data processing means for limiting or prohibiting the operation . Imaging means for imaging video, video encoding means for encoding video data captured by the imaging means, audio input means for generating input audio as audio data, audio data input by the audio input means 1 or 2 including at least the video encoding means among audio encoding means for encoding audio, audio decoding means for decoding encoded audio data, and audio output means for outputting audio based on audio data An operation control program comprising a plurality of means as data processing means, and executed by a computer of a data processing apparatus connected to an external device by transmission means for transmitting power and data ,
And possible information acquisition step acquires the external device information generated based on the performance of the pre-Symbol power power information is information about the source of the data processing apparatus and the external device,
A determination step of determining a data processing means for restricting or prohibiting an operation among the data processing means, based on at least one of the power information and the external device information acquired by the information acquisition step;
An operation control step for restricting or prohibiting the operation of the data processing means determined by the determining step ,
The data processing apparatus includes a power supply unit that is supplied with power from an external power source,
The power information is information indicating whether power is supplied to the data processing device by the power supply means,
In the determination step, when the power information is acquired by the information acquisition step, if the acquired power information is information indicating that power is not supplied by the power supply means, the operation is limited or Decide the data processing means to prohibit,
The external device information is information indicating the processing performance of the external device,
The external information acquired when the power information acquired by the information acquisition step indicates that power is not supplied by the power supply means and the external device information is acquired by the information acquisition step. A determination step of determining whether or not the processing performance of the external device indicated by the device information is equal to or higher than a threshold;
The determining step can determine the video encoding means as the data processing means for prohibiting the operation only when the determining step determines that the processing performance is equal to or higher than a threshold value. Operation control program. Imaging means for imaging video, video encoding means for encoding video data captured by the imaging means, audio input means for generating input audio as audio data, audio data input by the audio input means 1 or 2 including at least the video encoding means among audio encoding means for encoding audio, audio decoding means for decoding encoded audio data, and audio output means for outputting audio based on audio data A data processing apparatus comprising a plurality of means as data processing means, connected to an external device by transmission means for transmitting power and data,
Information acquisition means capable of acquiring power information, which is information about a power supply source to the data processing device, and external device information generated based on processing performance of the external device;
A determination unit that determines a data processing unit that restricts or prohibits an operation among the data processing unit based on at least one of the power information and the external device information acquired by the information acquisition unit;
Operation control means for restricting or prohibiting the operation of the data processing means determined by the determining means ;
Power supply means to be supplied with power from an external power source,
The power information is information indicating whether power is supplied to the data processing device by the power supply means,
When the power information is acquired by the information acquisition unit, the determination unit restricts the operation if the acquired power information is information indicating that no power is supplied by the power supply unit. Decide the data processing means to prohibit,
The external device information is information indicating the processing performance of the external device,
The external information acquired when the power information acquired by the information acquisition means indicates that no power is supplied by the power supply means and the external device information is acquired by the information acquisition means. A judgment means for judging whether the processing performance of the external device indicated by the device information is equal to or higher than a threshold;
The determining means can determine the video encoding means as a data processing means for prohibiting an operation only when the determining means determines that the processing performance is equal to or higher than a threshold value. Data processing device. Imaging means for imaging video, video encoding means for encoding video data captured by the imaging means, audio input means for generating input audio as audio data, audio data input by the audio input means 1 or 2 including at least the video encoding means among audio encoding means for encoding audio, audio decoding means for decoding encoded audio data, and audio output means for outputting audio based on audio data A data processing system comprising a data processing device comprising a plurality of means as data processing means, and an external device connected to the data processing device by transmission means for transmitting power and data,
Power supply means for supplying power to the data processing device from an external power source;
In the data processing device, a power information acquisition unit that acquires power information that is information indicating whether or not power is supplied to the data processing device by the power supply unit;
In the external device, among the data processing means, a data processing means for restricting or prohibiting operation is selected based on processing performance of the external equipment; and
In the data processing apparatus, when the power information acquired by the power information acquisition means is information indicating that power is not supplied by the power supply means, the data processing apparatus selected by the selection means An operation control means for restricting or prohibiting the operation of the data processing system.

Images