JP2008236385A - Portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable telephone system usable as a data recorder. <P>SOLUTION: The portable telephone system 200 includes a camera device 205, a GPS positioning device 206 for using a GPS positioning system to perform positioning of its own position, an acceleration sensor 208 and a central arithmetic processing unit 201. The central arithmetic processing unit 201 stores image data imaged by the camera device 205 and data of its own positioned position obtained by the GPS positioning device 206 in an external memory 214, and stops storing the data in the external memory 214 when acceleration detected by the acceleration sensor 208 is larger than a threshold. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a mobile terminal device, and more particularly to a mobile terminal device having a function of collecting peripheral information.

  For example, in the aircraft industry, for the purpose of investigating the cause of an accident, a flight recorder that records flight status, voice in a cockpit, and communication content has been conventionally mounted on an airplane.

  Also in the automobile industry, in recent years, as with flight recorders in airplanes, video information by a camera attached to the front as a vehicle-mounted device for investigating the cause of an accident, position information by GPS, acceleration, speed and direction indicator The installation of a drive recorder that records such information for a certain period of time before and after the accident has started.

  For example, Japanese Patent Laid-Open No. 2006-245836 proposes a camera-equipped mobile phone that can be used as a drive recorder.

The camera-equipped mobile phone is provided with an attachment mechanism for an automobile, and can be attached to the automobile via the attachment mechanism. This camera-equipped mobile phone has a function of receiving a vehicle speed signal and an impact detection signal from an automobile, and a function of continuously capturing moving images and storing the captured images in a memory in an endless manner. When the camera-equipped mobile phone detects an impact on the automobile, the video data is stored in a predetermined file in the auxiliary storage medium, a retention period is set, and the file is retained during the retention period.
JP 2006-245836 A

  However, various troubles occur not only in airplane and automobile accidents but also in everyday life. If image data or sound data for investigating the cause of such troubles can be saved, Never passed.

  The camera-equipped mobile phone proposed in the above publication is developed especially for automobiles, and is not necessarily suitable for storing various data in daily life.

  The present invention has been made in view of the above points, and is equipped with a data recorder function for a mobile phone or other mobile terminal device that is usually carried around, and is directed forward of the user or centered on the user. It is an object of the present invention to provide a portable terminal device that can collect and store peripheral information.

  In order to achieve the above object, the present invention provides at least one of a camera device that captures still images and dynamic images, a GPS positioning device that measures its position using a GPS satellite system, and a short-range wireless communication device. A mobile terminal device comprising at least an acceleration sensor, a central processing unit, and an external memory interface for storing data in an external memory, wherein the central processing unit is a still image captured by the camera device. Alternatively, at least one of dynamic image data, own positioning position data obtained by the GPS positioning device, and data transmitted / received via the short-range wireless communication device is stored in the external memory via the external memory interface. And the central processing unit has a predetermined threshold value for the acceleration detected by the acceleration sensor. Is equal to or greater than the threshold value, or when a command to that effect is received from a user of the portable terminal device, the portable terminal that stops saving the data in the external memory Providing the device.

  Preferably, the external memory interface stores the data for a predetermined time in the external memory, and the data exceeding the predetermined time is overwritten with new data in order from the old data.

  It is preferable that the central processing unit stores still image data or dynamic image data captured by the camera device in the external memory together with the time when the images are captured.

  The mobile terminal device can be configured as a mobile phone device, for example.

  The present invention further includes a camera device that captures still images and dynamic images, a GPS positioning device that measures its position using a GPS satellite system, and a short-range wireless communication device, an acceleration sensor, A method of using a portable terminal device comprising a data recorder as a still image or dynamic image data picked up by the camera device, data of its own positioning position obtained by the GPS positioning device, and the short distance A first process of storing at least one of data transmitted and received via a wireless communication device in an external memory, and an acceleration detected by the acceleration sensor is equal to or greater than a predetermined threshold Or when the user of the mobile terminal device sends a command to that effect to the external memory A method of using a second process to stop presence, a portable terminal device comprising as data recorder.

  In the first step, the data for a predetermined time is stored in the external memory, and data exceeding the predetermined time is overwritten with new data in order from the oldest data. preferable.

  In the first process, it is preferable that data of a still image or a dynamic image captured by the camera device is stored in the external memory together with a time when the images are captured.

  The present invention further includes a camera device that captures still images and dynamic images, a GPS positioning device that measures its position using a GPS satellite system, and a short-range wireless communication device, an acceleration sensor, A program for causing a computer to execute a method for using a mobile terminal device as a data recorder, the processing performed by the program is still image data or dynamic image data captured by the camera device, and the GPS positioning A first process for storing at least one of data of a positioning position obtained by the device and data transmitted / received via the short-range wireless communication device in an external memory, and an acceleration detected by the acceleration sensor in advance. If the threshold is equal to or greater than the threshold, or the user of the mobile terminal device If that originated the command to that effect from The provides a second process and is made of a program to stop saving to the external memory of the data.

  According to the present invention, the user can use his / her mobile phone device or other mobile terminal device as a data record without any change.

  That is, since the mobile terminal device according to the present invention can record data for a certain period retroactively from the time when the user turns off the data recorder function, it can reliably record the data at the moment that it wants to record. Is possible.

  Furthermore, since the function of the mobile phone device as a data recorder can be turned off by the magnitude of the acceleration detected by the acceleration sensor built in the mobile phone device according to the present invention, an accident or disaster can be used. It is possible to store a record for a certain period until an impact is applied to the mobile phone device.

  In addition, location information, moving images, and information from external peripheral devices connected via a short-range wireless communication device are recorded and stored in the mobile phone device in a concentrated manner. Can be easily incorporated into the system.

  1A is a perspective view of a mobile phone device 200 according to an embodiment of the present invention as viewed from the front, and FIG. 1B is a rear view of the mobile phone device 200 according to an embodiment of the present invention. It is a perspective view at the time of seeing from.

  As shown in FIGS. 1A and 1B, a mobile phone device 200 according to the present embodiment forms a first portion 221 that forms almost half of the mobile phone device 200 and a half of mobile phone device 200. The second portion 222 includes a hinge portion 223 that connects the first portion 221 and the second portion 222 to each other so as to be rotatable.

  That is, the mobile phone device 200 according to the present embodiment is a so-called foldable mobile phone device.

  The hinge portion 223 may be formed as a part of the first portion 221 or the second portion 222, or may be formed as an independent part separate from the first portion 221 and the second portion 222.

  As shown in FIG. 1A, an antenna 212 is attached to the upper end of the first portion 221. In addition, the display screen of the liquid crystal display device 203 is disposed on the front surface of the first portion 221 (the surface facing the second portion 222 when the cellular phone device 200 is folded). A speaker 210 is provided above the display screen.

  As shown in FIG. 1A, on the front surface of the second portion 222 (the surface on the side facing the first portion 221 when the cellular phone device 200 is folded), various keys constituting the key input circuit 204 are provided. The microphones 111 are arranged below the various keys.

  In addition, as shown in FIG. 1B, on the back surface of the second portion 222 (the surface that does not face the first portion 221 when the cellular phone device 200 is folded), a position close to the hinge portion 223 is provided. , A camera 205 is arranged.

  FIG. 2 is a block diagram showing the structure of the mobile phone device 200 according to this embodiment.

  As shown in FIG. 2, a mobile phone device 200 according to the present embodiment includes a central processing unit (CPU) 201, a built-in memory 202, a liquid crystal display device (LCD) 203, a key input circuit 204, and a camera 205. A GPS positioning device 206, a short-range wireless communication device 207, an acceleration sensor 208, an external memory interface 209, a speaker 210, a microphone 211, an antenna 212, and a wireless unit 213.

  The central processing unit 201 controls the overall operation of the mobile phone device 200 according to the present embodiment. Specifically, the operations of the built-in memory 202, the liquid crystal display device 203, the key input circuit 204, the camera 205, the GPS positioning device 206, the short-range wireless communication device 207, the acceleration sensor 208, the external memory interface 209, and the wireless unit 213 are controlled. To do.

  The built-in memory 202 stores a control program for controlling the operation of the central processing unit 201 and stores various data such as a phone book, mail, schedule, memo, voice, image, and moving image.

  The liquid crystal display device 203 displays various data on the display screen disposed in the first portion 221. For example, data input by the user via the key input circuit 204, contents of mail input from the other party's mobile phone device, and other various data specified by the user are displayed on the display screen.

  The key input circuit 204 includes a button switch group including a keyboard including a numeric keypad, function keys, and other various keys.

  The camera 205 captures a still image and a dynamic image via a lens disposed on the back surface of the second portion 222. The captured image data is stored in the built-in memory 202 via the central processing unit 201.

  The GPS positioning device 206 is a module that receives a signal from a GPS (Global Positioning System) satellite and measures the current position of the mobile phone device 200 according to the present embodiment.

  The short-range wireless communication device 207 transmits / receives data to / from the corresponding external peripheral device. In the mobile phone device 200 according to the present embodiment, the short-range wireless communication device 207 is configured as a communication device using Bluetooth (Bluetooth (registered trademark)).

  The acceleration sensor 208 detects acceleration generated in the mobile phone device 200 according to the present embodiment. Data indicating the detected acceleration is stored in the built-in memory 202 via the central processing unit 201.

  The acceleration generated in the mobile phone device 200 according to the present embodiment means that, for example, when an impact is applied to the mobile phone device 200 according to the present embodiment, some impact is applied to the user of the mobile phone device 200. This is the acceleration that occurs when

  In response to a command from the central processing unit 201, the external memory interface 209 records information collected by the camera 205, GPS positioning device 206, short-range wireless communication device 207, or acceleration sensor 208 in the external memory 214 in a ring buffer shape. The interface to save.

  Radio section 213 demodulates data received from the other party's mobile phone device via antenna 212. When the received data is an audio signal, the audio represented by the audio signal is output via the speaker 210. If the received data is an image signal, an image represented by the image signal is displayed on the display screen of the liquid crystal display device 203 via the central processing unit 201.

  Further, the wireless unit 213 modulates voice input by the user via the microphone 211 or data input via the key input circuit 204 and transmits the modulated data to the other party's mobile phone device via the antenna 212.

  FIG. 3 is a flowchart showing the operation of the mobile phone device 200 according to the present embodiment.

  The operation will be described below with reference to FIG.

  The display screen of the liquid crystal display device 203 of the mobile phone device 200 according to the present embodiment includes a mobile phone on the standby screen or when a user presses a predetermined key among a plurality of keys constituting the key input circuit 204. An inquiry as to whether or not to use the apparatus 200 as a data recorder, that is, an inquiry as to whether or not to set the data recorder function to ON is displayed (step S1).

  When the user does not set the data recorder function to ON (NO in step S1), the mobile phone device 200 is not used as a data recorder.

  When the user selects ON setting of the data recorder function (YES in step S1), the central processing unit 201 sets the data recorder function that uses the mobile phone device 200 as a data recorder to ON (step S2).

  Next, the central processing unit 201 reads the current time from a clock (not shown) built in the mobile phone device 200 (step S3).

  Next, the central processing unit 201 calculates the current position of the mobile phone device 200 based on the positioning data read from the GPS positioning device 206, and latitude / longitude data indicating the longitude and latitude indicating the current position of the mobile phone device 200. Is created (step S4).

  Next, the central processing unit 201 encodes the image data input from the camera 205 and the audio data input from the microphone 211 into a compression format such as 3GPP or MPEG4 (step S5).

  Next, the central processing unit 201 starts storing the encoded data in the external memory 214 via the external memory interface 209 as moving image data with audio.

  If there is an external device connected to the short-range wireless communication device 207, the central processing unit 201 also obtains information from the external device (step S6), and the external memory interface together with the above-mentioned moving image data with audio. It is stored in the external memory 214 via 209 (step S7).

  Data recorded in the external memory 214 via the external memory interface 209 is stored in the external memory 214 as a ring buffer. For this reason, when the buffer becomes full, new information is overwritten and stored in order from the oldest information.

  Therefore, it is possible to hold in the external memory 214 recording for a certain period of time until the data recorder function is turned off.

  The data recording operation to the external memory 214 is continuously performed until the data recorder function is set to OFF (step S9).

  There are the following two cases where the data recorder function is set to OFF.

  The first is a case where the user sets the data recorder function to OFF from the menu of the mobile phone device 200.

  The second is a case where the central processing unit 201 sets the data recorder function to OFF based on input data from the acceleration sensor 208.

  That is, the acceleration sensor 208 constantly detects the acceleration generated in the mobile phone device 200, and the detected acceleration value is transmitted to the central processing unit 201. The central processing unit 201 determines whether or not the acceleration value transmitted from the acceleration sensor 208 is equal to or greater than a predetermined threshold value (step S8).

  When the acceleration value transmitted from the acceleration sensor 208 is smaller than a predetermined threshold value, the central processing unit 201 does not set the data recorder function to OFF.

  If the acceleration value transmitted from the acceleration sensor 208 is equal to or greater than a predetermined threshold value, the central processing unit 201 sets the data recorder function to OFF.

  When the acceleration value transmitted from the acceleration sensor 208 is equal to or larger than a predetermined threshold value, a large impact is applied to the user of the acceleration sensor 208 and the mobile phone device 200. That is, it is assumed that an accident or some other accident has occurred.

  As described above, the central processing unit 201 determines whether or not to turn off the data recorder function of the mobile phone device 200 (step S9).

  When the central processing unit 201 determines that the data recorder function of the mobile phone device 200 is not set to OFF (NO in step S9), the above-described steps S3 to S8 are repeated.

  If the central processing unit 201 determines that the data recorder function of the mobile phone device 200 is set to OFF (YES in step S9), the central processing unit 201 sets the data recorder function of the mobile phone device 200 to OFF. (Step S10).

  When the data recorder function of the cellular phone device 200 is set to OFF, the storage of the data in the external memory 214 is stopped.

  The data stored in the external memory 214 is obtained by taking out the external memory 214 from the external memory interface 209 and reading out and analyzing the data in the external memory 214 in another device (for example, a personal computer) to obtain time data, latitude / longitude Data, moving image data, and externally connected device data can be played back synchronously.

  That is, it is possible to perform synchronized playback of the map display of recorded locations, audio-video, and information data of externally connected devices.

  In other words, when an accident or some other accident occurs in the user of the mobile phone device 200, the data collected by the mobile phone device 200 can be used until just before that.

  As described above, according to the mobile phone device 200 according to the present embodiment, the following effects can be obtained.

  The first effect is that data for a certain period can be recorded retroactively from the time when the user turns off the data recorder function, so that it is possible to reliably record the data at the moment to be recorded.

  The second effect is that the data recorder function can be turned off according to the magnitude of the acceleration detected by the acceleration sensor 208 built in the mobile phone device 200, so that the mobile phone device 200 is impacted by an accident or disaster. The record of a certain period until it is added can be preserved.

  The third effect is that the position information, the moving image, and the information from the external peripheral device connected via the short-range wireless communication device 207 are intensively recorded and stored in the mobile phone device 200. The telephone device 200 can be easily incorporated into other systems.

  The fourth effect is that location information, moving images, and information from external peripheral devices connected via the short-range wireless communication device 207 are stored in the external memory 214 via the external memory interface 209. It is easy to share data and has high compatibility with computer software.

  The fifth effect is that location information, moving images, and information from external peripheral devices connected via the short-range wireless communication device 207 are centrally managed in the mobile phone device 200. By connecting to the Internet network, it is easy to enjoy new services using such information.

  The sixth effect is that even when there is no connected external peripheral device connected via the short-range wireless communication device 207, the mobile phone device 200 can record and reproduce moving image with location information and sound by itself. Therefore, it is possible to record in the daily life of the user, to reconfirm information that has been missed or missed, and to record without missing a scene that is desired to remain for a long time.

  The mobile phone device 200 according to the present embodiment is not limited to the above configuration, and various modifications can be made.

  The mobile phone device 200 according to the present embodiment is configured to include a camera 205, a GPS positioning device 206, and a short-range wireless communication device 207, but it is not always necessary to include all of these. It suffices to have at least one of the camera 205, the GPS positioning device 206, and the short-range wireless communication device 207.

  In the cellular phone device 200 according to the present embodiment, the short-range wireless communication device 207 is configured as a communication device using Bluetooth (Bluetooth (registered trademark)). It is also possible to configure as a short-range wireless communication device using infrared rays.

  Alternatively, it is possible to utilize short-range wireless communication technologies such as active RFID, DSRC, WiFi, NFC, and ZigBee.

  Further, since the capacity of the external memory 214 is finite, when data is recorded for a longer time, the user designates data to be recorded via the key input circuit 204 so that only desired data is recorded in the data recorder. It is also possible to collect and store by the mobile phone device 200 as.

  Further, in the above-described embodiment, the present invention is applied to the mobile phone device 200, but the application target of the present invention is not limited to the mobile phone device. Any portable terminal device that can perform wireless communication with other devices can be applied to any terminal device.

  Hereinafter, application examples of the mobile phone device 200 according to the present embodiment will be described.

  FIG. 4 is a block diagram showing an outline when the mobile phone device 200 according to this embodiment is applied to an automobile, and FIG. 5 is an image diagram showing a concept when the mobile phone device 200 according to this embodiment is applied to an automobile. It is.

  Each ECU (Electronic Control Unit), for example, an information control ECU 43, a powertrain system ECU 44, a body system ECU 45, a safety system ECU 46, and the like attached to the inside of the automobile is shown in FIG. As shown in FIG. 2, the connection is often made by various in-vehicle LANs 47 such as CAN (Controller Area Network), Lin (Local Interconnect Network), and FlexRay.

  For example, as shown in FIG. 4, by attaching a short-range wireless communication module 42 to the in-vehicle LAN 47, a system similar to a flight recorder can be easily constructed.

  That is, as shown in FIG. 5, the user attaches the mobile phone device 200 to the inner surface of the passenger car 50 above the windshield and sets the data recorder function of the mobile phone device 200 to ON via the key input circuit 204. .

  As a result, the current position data, the image and sound in front of the vehicle, and the wheel control data of the tire via the short-range wireless communication module 42, the steering angle data of the steering, the brake control data, the accelerator opening data, etc. In addition, information such as a wiper operation can be recorded in the mobile phone device 200.

  Should an accident occur in the passenger car 50, the central processing unit 201 detects a steep change in the signal indicating the acceleration value transmitted from the acceleration sensor 208 (ie, transmitted from the acceleration sensor 208). The data recorder function is set to OFF by detecting that the acceleration value to be exceeded has exceeded the threshold). For this reason, the situation at the time of the accident can be recorded and saved in the external memory 214 in detail.

  As described above, the cellular phone device 200 according to the present embodiment functions as a drive recorder for the passenger car 50 by being attached to the passenger car 50.

  In addition, the mobile phone device 200 according to the present embodiment can be connected to a medical device via the short-range wireless communication device 207.

For example, information from devices such as a pulse sensor and a thermometer attached to the human body and information from a blood pressure meter are collected, and the information is sent to the medical center server via the mobile phone device 200 together with patient position information and video information. 6 can monitor the condition of a patient at a remote location, and can respond quickly to an emergency situation. FIG. It is the schematic which shows an example in the case of using as a data recorder.

  As shown in FIG. 6, when the mobile phone device 200 is used as a data recorder in daily life, after the data recorder function of the mobile phone device 200 is set to ON via the key input circuit 204, The cellular phone device 200 is inserted into the breast pocket 51 of the user's clothes so that the lens faces the front.

  Accordingly, the mobile phone device 200 can be used as a normal mobile phone, and can also be used as a data recorder for recording an accident in the daily life of the user.

  The portable terminal device according to the present invention can be used as a drive recorder for an automobile by being mounted on the automobile.

  Furthermore, the portable terminal device according to the present invention transmits information related to the patient's condition to the remote medical center, thereby enabling the remote medical center to monitor the condition of the patient.

  Moreover, the user can use the portable terminal device according to the present invention as a data recorder for recording the daily life of the user only by storing the portable terminal device according to the present invention in a chest pocket or other place.

  Thus, the portable terminal device according to the present invention can be applied to all fields where it is necessary to record some accidents.

1A is a perspective view of a mobile phone device according to an embodiment of the present invention as viewed from the front, and FIG. 1B is a view of the mobile phone device according to an embodiment of the present invention as viewed from the rear. FIG. FIG. 2 is a block diagram showing the structure of a mobile phone device according to an embodiment of the present invention. FIG. 3 is a flowchart showing the operation of the mobile phone device according to the embodiment of the present invention. FIG. 4 is a block diagram showing an outline when the cellular phone device according to the embodiment of the present invention is applied to an automobile. FIG. 5 is an image diagram showing a concept when the cellular phone device according to one embodiment of the present invention is applied to an automobile. FIG. 6 is a schematic diagram illustrating an example in which a user of the mobile phone device according to an embodiment of the present invention uses the mobile phone device as a data recorder in daily life.

Explanation of symbols

200 Mobile phone device 221 according to an embodiment of the present invention First part 222 Second part 223 Hinge part 201 Central processing unit (CPU)
202 Built-in memory 203 Liquid crystal display (LCD)
204 Key input circuit 205 Camera 206 GPS positioning device 207 Short-range wireless communication device 208 Acceleration sensor 209 External memory interface 210 Speaker 211 Microphone 212 Antenna 213 Wireless unit 214 External memory 42 Short-range wireless communication module 43 Information system ECU
44 Powertrain ECU
45 Body ECU
46 Safety system ECU
50 passenger cars

Claims (8)

At least one of a camera device that captures still images and dynamic images, a GPS positioning device that measures its position using a GPS satellite system, and a short-range wireless communication device;
An acceleration sensor;
A central processing unit;
An external memory interface for storing data in an external memory;
A mobile terminal device comprising at least
The central processing unit includes data of a still image or a dynamic image captured by the camera device, data of its own positioning position obtained by the GPS positioning device, and data transmitted / received via the short-range wireless communication device Is stored in an external memory via the external memory interface,
The central processing unit, when the acceleration detected by the acceleration sensor is equal to or greater than a predetermined threshold, or received a command to that effect from the user of the mobile terminal device In such a case, a portable terminal device that stops storing the data in the external memory.   The external memory interface stores the data for a certain period of time in the external memory, and the data that exceeds the data for the certain period of time is overwritten with new data in order from the oldest data. Item 2. The mobile terminal device according to Item 1.   The central processing unit is configured to store still image data or dynamic image data captured by the camera device in the external memory together with a time when the images are captured. The mobile terminal device according to 1 or 2.   The mobile terminal device according to claim 1, wherein the mobile terminal device is a mobile phone device. A portable terminal device comprising at least one of a camera device that captures a still image and a dynamic image, a GPS positioning device that measures its own position using a GPS satellite system, and a short-range wireless communication device, and an acceleration sensor A method for use as a data recorder,
At least one of still image data or dynamic image data captured by the camera device, own positioning position data obtained by the GPS positioning device, and data transmitted / received via the short-range wireless communication device is stored in an external memory. The first process of saving
When the acceleration detected by the acceleration sensor is equal to or greater than a predetermined threshold, or when a command to that effect is transmitted from the user of the mobile terminal device, A second step of canceling storage in the external memory;
A method of using a portable terminal device comprising: as a data recorder.   In the first step, the external memory stores the data for a predetermined time, and the data exceeding the predetermined time is overwritten with new data in order from the oldest data. A method of using the portable terminal device according to claim 5 as a data recorder.   The still image or dynamic image data captured by the camera device in the first step is stored in the external memory together with the time when the images were captured. Item 7. A method for using the mobile terminal device according to Item 5 or 6 as a data recorder. A portable terminal device comprising at least one of a camera device that captures a still image and a dynamic image, a GPS positioning device that measures its own position using a GPS satellite system, and a short-range wireless communication device, and an acceleration sensor A program for causing a computer to execute a method used as a data recorder,
The processing performed by the program is as follows:
At least one of still image data or dynamic image data captured by the camera device, own positioning position data obtained by the GPS positioning device, and data transmitted / received via the short-range wireless communication device is stored in an external memory. The first process to be stored in
When the acceleration detected by the acceleration sensor is equal to or greater than a predetermined threshold, or when a command to that effect is transmitted from the user of the mobile terminal device, A second process of canceling storage in the external memory;
A program that consists of:

Images