JP5473034B2 - Terminal device and program - Google Patents

Description

  The present invention relates to a terminal device such as a mobile phone and a program.

  In general, a terminal device such as a mobile phone can store an image such as a face photograph in association with various information such as a name, a telephone number, and an e-mail address of a communication partner and store them as address book data. In order to easily store various information such as the name, telephone number, and mail address of the communication partner, a function called a business card exchange function or a profile exchange function using infrared communication is known. (See Patent Document 1).

JP 2008-236444 A

  However, in the above-described prior art, the received information on the communication partner is stored as address book data together with the image of the partner, but for the user, the image of the communication partner can be taken, After performing operations such as downloading from an external device, the operation becomes complicated because information such as name, phone number, and mail address and the image need to be selected and associated with each other. The problem remains.

  The subject of this invention is enabling it to memorize | store the received information and the acquired image corresponding appropriately.

In order to solve the above-described problem, the invention described in claim 1 is a receiving unit that receives information, an acquiring unit that acquires an image, and an image content determining unit that determines the content of an image acquired by the acquiring unit. Control means for storing, in the storage means, the information received by the receiving means in association with the image acquired by the acquiring means when the image content determining means determines that the content of the image includes a person; An image pickup means for picking up an image, and the control means operates the image pickup means when the image content determination means determines that the image content does not include a person, and the image pickup means The captured image and the information received by the receiving unit are associated with each other and stored in the storage unit .

As an invention dependent on claim 1 , the control means causes the imaging means to operate in a mode suitable for portrait photography when the image content discrimination means determines that the image content does not include a person. The invention according to claim 2 is characterized.

As an invention dependent on any one of claims 1 and 2 , it further comprises a display determining means for determining whether or not the image acquired by the acquiring means is being displayed, wherein the control means When the determining means determines that the image is being displayed and the image content determining means determines that the content of the displayed image includes a person, the information received by the receiving means is displayed on the display The invention according to claim 3 may be stored in the storage means in association with the image inside.

As an invention dependent on any one of claims 1 and 2 , presence determination means for determining whether or not there is an image acquired by the acquisition means within a predetermined time from the time when the information is received by the reception means. And the control means determines that there is an image acquired by the presence determination means within a predetermined time, and the image content determination means determines that the content of the image includes a person. The invention according to claim 4 , wherein the information received by the receiving means is stored in the storage means in association with the image.
In order to solve the above-described problem, the invention described in claim 5 is a reception means for receiving information, an acquisition means for acquiring an image, and an image content determination for determining the content of an image acquired by the acquisition means. And when the content of the image is determined to include a person by the image content determination unit and the storage unit stores the information received by the reception unit in association with the image acquired by the acquisition unit And a display determining unit that determines whether or not the image acquired by the acquiring unit is being displayed, and the control unit determines that the image is being displayed by the display determining unit And when the image content determination means determines that the content of the image being displayed includes a person, the information received by the reception means is paired with the image being displayed. Put it in the storage means, characterized in that.

In order to solve the above-described problem, the invention described in claim 6 is directed to a computer, a receiving unit for receiving information, an acquiring unit for acquiring an image, and an image content for determining the content of an image acquired by the acquiring unit. Control means for storing in the storage means the information received by the receiving means in association with the image acquired by the acquiring means when the image contents are determined to include a person by the determining means and the image content determining means; A program that functions as an imaging unit that captures an image, wherein the control unit operates the imaging unit when the image content determination unit determines that the image content does not include a person; in the storage means in association with information received with the image captured by the imaging means by the receiving means, characterized in that pro It is a lamb.
Further, in order to solve the above-described problem, the invention according to claim 7 is directed to a computer, a receiving unit for receiving information, an acquiring unit for acquiring an image, and an image content for determining the content of an image acquired by the acquiring unit. Control means for storing in the storage means the information received by the receiving means in association with the image acquired by the acquiring means when the image contents are determined to include a person by the determining means and the image content determining means; And a program that functions as a display determining unit that determines whether or not the image acquired by the acquiring unit is being displayed, wherein the control unit determines that the image is being displayed by the display determining unit. And when the image content determination unit determines that the content of the displayed image includes a person, the reception unit receives the image. And information is stored in the storage means in association with the image in the display, a program characterized by.

  According to the present invention, it is possible to store the received information and the acquired image in association with each other appropriately, and the operability can be greatly improved.

The block diagram which showed the communication network system which can use the mobile telephone applied as a terminal device. FIG. 2 is a block diagram showing basic components of the mobile phone 1. The figure for demonstrating the reception information storage part M3. The figure for demonstrating the image memory | storage part M4. The figure for demonstrating the address book memory | storage part M5. The figure for demonstrating the imaging | photography information storage part M6. The flowchart which showed the outline | summary of the whole operation | movement by the side of the mobile telephone 1 by which execution is started with power activation. 8 is a flowchart for explaining in detail an image storage process (step A7 in FIG. 7). 8 is a flowchart for explaining reception information storage processing (step A11 in FIG. 7) in detail.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone as a terminal device, and FIG. 1 is a block diagram showing a communication network system in which the mobile phone can be used.
The cellular phone 1 is, for example, a foldable one in which two casings (an operation unit casing and a display unit casing) are attached so as to be openable and closable. Functions, an Internet connection function (Web access function), a camera function, a near field communication function, and the like. This short-range communication function is used when various types of information such as profile data are transmitted / received to / from an external device (another mobile phone) 2, but communication between the mobile phone 1 and the external device 2. For example, although not shown, the wireless LAN (local area network) communication may be performed via a repeater, such as a home network or a company network.

  When the mobile phone 1 is connected to the wireless communication network (mobile communication network) 3 from the nearest base station 3A and exchange 3B, the mobile phone 1 is connected to the external device (other mobile phone) 2 via the wireless communication network 3. It becomes possible to make a call. In addition, when the mobile phone 1 is connected to the Internet 4 via the wireless communication network 3, it is possible to send and receive e-mails, access a Web site and browse, and the information distribution device 5. Various data such as new news and weather forecasts distributed from the Internet can be downloaded via the Internet 4 and the wireless communication network 3. Further, when the mobile phone 1 is connected to the information / image sharing device 6 via the wireless communication network 3 and the Internet 4, the mobile phone 1 shares information and images with the registered user and transmits / receives each other ( (Upload, download) can be performed.

FIG. 2 is a block diagram showing basic components of the mobile phone 1.
The central control unit 11 operates by supplying power from a battery unit 12 having a secondary battery (not shown), and controls the overall operation of the mobile phone 1 according to various programs in the storage unit 13. It has a processing device, a memory (not shown), and the like. The storage unit 13 includes a program storage unit M1, various information temporary storage units M2, a received information storage unit M3, an image storage unit M4, an address book storage unit M5, a photographing information storage unit M6, an information determination condition storage unit M7, and an image determination. A condition storage unit M8 and the like are provided. Note that the storage unit 13 may include a removable portable memory (recording medium) such as an SD card or an IC card, or may be on a predetermined external server (not shown).

  The program storage unit M1 stores a program and various applications for realizing the present embodiment in accordance with the operation procedure shown in FIGS. 7 to 9, and stores information necessary for the program. Yes. The various information temporary storage unit M2 is a work area that temporarily stores various information necessary for the mobile phone 1 to operate, such as flag information, timer information, and screen information. The received information storage unit M3, image storage unit M4, address book storage unit M5, imaging information storage unit M6, information determination condition storage unit M7, and image determination condition storage unit M8 will be described in detail later.

  The radio communication unit 14 includes a radio unit, a baseband unit, a demultiplexing unit, and the like (not shown). For example, during operation of a call function, an e-mail function, an Internet connection function, etc., data communication with the nearest base station 2A is performed. When transmitting / receiving the call function, a signal is received from the receiving side of the baseband unit and demodulated into a received baseband signal, and then the audio is output from the speaker SP for calling through the audio signal processing unit 15, The input voice data from the call microphone MC is taken from the voice signal processing unit 15 and encoded into a transmission baseband signal, which is then given to the transmission side of the baseband unit and transmitted from the antenna AT1. The wireless LAN communication described above is also performed via the wireless communication unit 14.

  The short-range communication unit 16 is a component that constitutes the above-described short-range communication function, and is in close proximity to the external device (another mobile phone) 2 by a non-contact type Bluetooth (registered trademark) via the antenna AT2. This is a distance communication, and communication is performed within the communicable area (for example, within a radius of 5 m). Further, when communicating between the mobile phone 1 and the external device (other mobile phone) 2, mutual device identification information is transmitted and received to identify the communication partner as a cooperation target. The short-range communication unit 17 is not limited to Bluetooth (registered trademark) communication, and may be configured to perform infrared communication or the like.

  The imaging unit 17 is a component that constitutes a camera function, has an imaging element (for example, a CCD or a CMOS), and can capture moving images in addition to still image shooting. The imaging unit 17 includes a photographing lens, a lens / mirror block such as a mirror, a flash for illumination, a driving system thereof, a distance measuring sensor, a light amount sensor, an analog processing circuit, a signal processing circuit, a compression / expansion circuit, and the like. Equipped with optical zoom adjustment control, auto focus drive control, shutter drive control, exposure, white balance, etc. The imaging unit 17 includes a bifocal lens and a zoom lens that can switch between telephoto and wide angle according to the subject, and operates an angle-of-view changing mechanism that varies the focal length to perform telephoto / wide-angle and zoom photography. In addition to various shooting information for camera functions, for example, exposure value, white balance, sharpness, contrast, zoom value, etc. can be arbitrarily set, and shooting modes prepared in advance include In addition to the aperture priority mode and shutter speed priority mode, the portrait mode can be arbitrarily set.

  That is, in the camera function of this embodiment, various shooting parameters suitable for shooting a scene are stored in advance for each shooting scene, and any shooting scene (shooting mode) can be operated by a user according to the subject. Is selected, the shooting parameter corresponding to the shooting scene (shooting mode) is read out and set as shooting information in the imaging unit 17 (so-called best shot function), and according to the type of the subject such as a landscape or a person. Thus, it is possible to arbitrarily set shooting modes such as a person mode suitable for portrait photography, a landscape mode suitable for landscape photography, and a sports mode suitable for sports photography.

  The display unit 18 uses high-definition liquid crystal, and displays display information such as character information, captured images, and standby images. Although the display unit 18 is a display unit provided in the mobile phone 1, it may be any external display device such as an external monitor. The operation unit 19 inputs dial input, character input, command input, and the like. The operation unit 19 includes a shutter key for a camera function, and the central control unit 11 performs an input operation from the operation unit 19. Processing according to the signal is executed. The RTC (real-time clock module) 20 constitutes a clock unit, and the central control unit 11 acquires the current date and time from the RTC 21. The notification unit 21 includes a sound speaker 21A, an LED (light emitting diode) 21B, and a vibration motor 21C. The notification unit 21 is driven at the time of an incoming call to notify an incoming call, and is also driven at the time of an alarm notification.

FIG. 3 is a diagram for explaining the reception information storage unit M3.
The received information storage unit M3 stores, as various received information, various types of information downloaded from the data 4 such as new news and weather forecasts distributed from the information distribution device 5 via the Internet 4 and the wireless communication network 3. Or store information such as profiles received from the external device (other mobile phone) 2 via short-range communication, such as “information ID”, “reception date”, “type”, “actual data” The newly received information is additionally stored in the received information storage unit M3. “Information ID” is an item for storing a series of Nos identifying received information. “Reception date” is an item for storing date information when information is received.

  “Type” is an item for storing the type of received information (for example, the other party's profile, news, weather forecast, etc.), and “actual data” is an item for storing actual data of received information. This “actual data” is further divided into a plurality of sub-items (fields), each sub-item has “item ID” and “content”, and this “item ID” is an attribute ( The other party's profile shows name, phone number, address, etc., news shows genre, body, title, etc.), and “content” shows the contents of the sub-item. The configuration of each small item differs depending on the type of received information.

FIG. 4 is a diagram for explaining the image storage unit M4.
The image storage unit M4 stores a captured image acquired from the camera function or an image acquired from the external device (another mobile phone) 2 or the like. The “image ID”, “acquisition date”, “actual data”, “ The newly acquired image having each item of “additional information”... Is additionally stored in the image storage unit M4. “Image ID” is an item for storing a series of Nos identifying received information. “Acquisition date / time” is an item for storing date / time information when an image (such as a face image of the other party) is acquired from the camera function or the external device (other mobile phone) 2. “Real data” is an item for storing an acquired image acquired from the camera function, the external device (another mobile phone) 2 or the like as an image file. “Additional information” is an item for storing information (for example, a title, a shooting mode, etc.) added to the image.

FIG. 5 is a diagram for explaining the address book storage unit M5.
The address book storage unit M5 stores address book data as information about a communication partner, and includes “address book ID”, “name”, “phone number”, “mail address”, “address”, “image ID”, It has each item of ... The “address book ID” is an item for storing a series No. for identifying address book data. “Name”, “Telephone number”, “Mail address”, “Address” are information related to the communication partner and are created by inputting each item by user operation or extracting necessary item data from the received information. Information. “Image ID” is image identification information for linking to an image (such as a face image of a communication partner) stored in the image storage unit M4.

FIG. 6 is a diagram for explaining the photographing information storage unit M6.
The shooting information storage unit M6 is one of the components of the above-described best shot function, and stores various shooting parameters (shooting information) in association with shooting modes. "Stores various shooting modes, and" Item "in the vertical direction stores various shooting parameters. Here, there are “Manual mode”, “Portrait mode”, “Landscape mode”, “Sport mode”, etc. as shooting modes. This is the shooting mode. “Portrait mode”, “landscape mode”, and “sport mode” are shooting modes suitable for shooting a person, landscape, and sports, as described above.

  The “setting flag” associated with each shooting mode indicates which shooting mode is selected by the user operation as the currently effective shooting mode, and the flag “1” indicates the currently effective shooting mode. Indicates the mode. In the example shown in the figure, “person mode” is selected as the currently effective shooting mode. In addition, “Auto Focus”, “Auto Flash”, “Shutter Speed”, “Aperture Value”, “White Balance”, etc. are recorded as shooting parameters, and ON / OFF is stored according to the corresponding shooting mode. . In the figure, a portion surrounded by a thick line indicates a range that can be arbitrarily set by a user operation, and each of the “setting flag” and “manual mode” shooting parameters corresponding to each shooting mode can be set arbitrarily. it can.

  Although not shown, the information determination condition storage unit M7 and the image determination condition storage unit M8 store storage conditions for storing the received information in the address book storage unit M5 as image-added address book data in association with the acquired image ( Hereinafter, the information determination condition storage unit M7 stores information for determining whether the received party identification information is included in the received information as the address book storage condition. . That is, the central control unit 11 analyzes the content of the received information, so that the other party identification information is included in the received information, that is, at least one of a name (person name), a telephone number, and an e-mail address is included. The information determination condition storage unit M7 uses, for example, a person name / place name database, a telephone number, and the like as information for determining whether the received party identification information is included in the received information. The configuration of the number string to be regarded, the structure of the character string to be regarded as an e-mail address, and the like are stored, and the central control unit 11 determines that the address book storage condition is satisfied if the received information includes the partner identification information. ing.

  The image determination condition storage unit M8 stores information for determining the attribute of the content of the acquired image as an address book storage condition, and the central control unit 11 analyzes the content of the acquired image, However, the image determination condition storage unit M8 uses, for example, the head as information for determining whether or not a person is included in the acquired image. The features of both arms and torso and their positional relationship are stored, and the features of the nose, eyes and mouth and their positional relationship are stored. The central control unit 11 stores the person in the acquired image. If it is included, it is determined that the address book storage condition is satisfied.

  Other address book storage conditions include receiving information while displaying an image, receiving information within a predetermined time after obtaining the image, and conversely, receiving an image within a predetermined time after receiving the information. Have acquired. Therefore, it is determined that the address book storage condition is satisfied when an image including a person (a captured image or a received image) is acquired and displayed in a predetermined time (for example, 2). Within a minute) when information including partner identification information (for example, profile data) is received, and conversely, when receiving information including partner identification information and displaying the information, This is a case where an image included by a person is acquired within a predetermined time.

  When the central control unit 11 receives the information, the central control unit 11 refers to the image storage unit M4 and stores an image of “acquisition date” corresponding to a date and time that is a predetermined time (for example, 2 minutes) from the current time. Whether or not information is received within a predetermined time after image acquisition is determined based on whether or not the image is acquired. Similarly, when the central control unit 11 acquires an image, the central control unit 11 refers to the reception information storage unit M3, and the reception information of “reception date” corresponding to the date and time that goes back a predetermined time (for example, 2 minutes) from the current time. Whether or not an image has been acquired within a predetermined time after information reception is determined based on whether it is stored.

  When the central control unit 11 determines that the storage condition is satisfied, the central control unit 11 extracts necessary item data from the received information, generates address book data with an image associated with the acquired image, and generates an address book storage unit. It is made to memorize | store in M5. In this case, the storage in the address book storage unit M5 is not limited to additional storage (additional registration of new data), but may be overwritten (rewriting existing data). In addition, in the case of overwrite storage, the address book data generated this time for existing address book data that matches any one of “phone number”, “mail address”, and “address” in addition to “name” Is overwritten.

  Next, the operation concept of the mobile phone 1 in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Moreover, the operation | movement according to the above-mentioned program code transmitted via transmission media, such as a network, can also be performed sequentially. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 7 is a flowchart showing an outline of the overall operation on the mobile phone 1 side which is started to be executed when the power is turned on.
First, when a power-on operation to turn on the power is performed (YES in step A1), the central control unit 11 reads and displays a predetermined standby image, or communicates with the base station 2A to perform the position measurement. A standby process for registration is performed (step A2). In this state, when an operation for instructing activation of the camera function is performed (step A3), the camera function is activated and the imaging information storage unit M6 is referred to set the imaging mode in which the “setting flag” is “1”. As the associated shooting parameters, “auto focus”, “auto flash”, “shutter speed”, “aperture value”, “white balance”,... Are read and set in the imaging unit 17 (step A4).

  Then, in response to the shutter key operation on the operation unit 19, when the image capturing unit 17 performs image capturing corresponding to the capturing mode (step A 5), the image acquired from the image capturing unit 17 is displayed on the display unit 18. (Step A6). Here, the image displayed on the display unit 18 is continuously displayed until the next image is switched and displayed, or until an end operation such as the end of the camera function is performed. This image display is erased when it is performed or when the casing is folded and closed. Then, after executing the next image storage process (step A7), if the camera function is activated, the camera function is terminated (step A8), and the process returns to step A3 described above.

FIG. 8 is a flowchart for explaining the image storing process (step A7 in FIG. 7) in detail.
First, the central control unit 11 acquires date and time information from the RTC 21 as an image acquisition date and time (step B1), and stores the acquired image with the date and time information added as an image file in the image storage unit M4 (step B2). Since the camera function is now activated, the date and time information (shooting date and time) is acquired from the RTC 21 as the acquisition date and time, and the captured image acquired from the imaging unit 17 is stored as an image file together with the shooting date and time (acquisition date and time) Store in the part M4. Then, while analyzing this acquired image (step B3), it is checked whether or not a person is included in the acquired image by comparing the analysis result with the contents of the image discrimination condition storage unit M8 (step B4). If no person is included (NO in step B4), the flow returns to the flow of FIG. 7 assuming that the address book storage condition is not satisfied.

  As a result of analyzing the acquired image, if a person is included in the image (YES in step B4), it is determined that the address book storage condition is satisfied, the process proceeds to next step B5, and “ Whether or not there is information received within a predetermined time (for example, 2 minutes) from the date / time information (image acquisition date / time) when the image is stored in the image storage unit M4 by searching for “reception date / time”. (Step B6). In other words, since the camera function is now activated, it is within a predetermined time after receiving information based on whether or not the received information is stored within a predetermined time after the current shooting date and time. It is checked whether an image has been acquired. As a result, if there is no corresponding reception information (NO in step B6), it returns to the flow of FIG. 7 assuming that the address book storage condition is not satisfied.

  In addition, if there is information received within a predetermined time after the current shooting date and time (YES in step B6), it is a case where an image is acquired within a predetermined time after the information is received. As a result, the process proceeds to the next step B7, where the contents of the received information are analyzed, and the analysis result is collated with the contents of the information determination condition storage unit M7, so that the other party identification information is included in the received information. That is, it is checked whether or not at least one partner identification information of name (person name), telephone number, and mail address is included (step B8).

  If the other party identification information is not included in the received information (NO in step B8), the process returns to the flow of FIG. 7 assuming that the address book storage condition is not satisfied, but if the other party identification information is included (step B8). YES), the process proceeds to a process of converting the received information into address book data on the assumption that the address book storage condition is satisfied (step B9). In this case, “name”, “phone number”, “email address”, “address”, etc. are extracted from the received information as item data constituting the address book data, or conversely, the address book data is constituted. The received information is converted into address book data by deleting items other than item data. In order to associate the received information thus converted with the acquired image, an “image ID” of the image read from the image storage unit M4 is added to the converted received information, thereby adding an image-attached address associated with the acquired image. Book data is generated and additionally stored or overwritten in the address book storage unit M5 (step B10).

  As described above, the image storage process (step A7 in FIG. 7) is executed in response to the camera function activation operation (step A3 in FIG. 7), but is also executed when an image is received from outside. . That is, when an image transmitted from the information / image sharing device 6 or the external device (another mobile phone) 2 is received or an automatically transmitted image is received according to a user operation (in step A9). (YES) After the received image is acquired and displayed on the display unit 18 (step A6), the process proceeds to this image storage process (step A7). Also in this case, as in the case where the camera function described above is activated, the operation according to the flow of FIG. 8 is executed to acquire the date / time information from the RTC 21 and the acquired image with the date / time information added is an image file. Is stored in the image storage unit M4 (steps B1 and B2). And, on the condition that a person is included in the received image, and that the image is acquired within a predetermined time after information reception, and that the other party identification information is included in this received information, The received information and the acquired image are associated with each other and stored in the address book storage unit M5 (steps B3 to B10).

In the above description of the image storage process, the case where the reception information and the acquired image exist in a one-to-one relationship has been described. However, a plurality of pieces of information are sequentially received and stored in the reception information storage unit M3. In this state, when a plurality of images are sequentially acquired by image shooting or image reception, the image storage processing is basically the same as described above. In this case, however, a predetermined time (for example, 2 As long as the information is received within a time period that goes back (minutes), the individual information is specified sequentially according to the reception order, and the specified information is specified while sequentially specifying the individual acquired images according to the acquisition order. And the image are associated with each other and stored in the address book storage unit M5.
On the other hand, if any information is received (YES in step A10 in FIG. 7), that is, information transmitted from the information / image sharing device 6 or the external device (other mobile phone) 2 according to the user's operation is received. When the automatically transmitted information is received, the process proceeds to the next received information storage process (step A11).

FIG. 9 is a flowchart for explaining the received information storage process (step A11 in FIG. 7) in detail.
First, the date and time information is acquired from the RTC 21 as the date and time when the information is received (step C1), and the received information is acquired together with the date and time information and stored in the information storage unit M3 (step C2). Then, the process proceeds to step C3, where the received information received this time is analyzed, and the analysis result is collated with the contents of the information determination condition storage unit M7. It is checked whether or not at least one of a number and an e-mail address is included (step C4). If the partner identification information is not included (NO in step C4), the flow returns to the flow of FIG. 7 assuming that the address book storage condition is not satisfied, but if the partner identification information is included (YES in step C4). Assuming that the address book storage condition is satisfied, the process proceeds to the next step C5, where it is checked whether there is an image currently being displayed.

  If there is no image currently displayed (NO in step C5), the process proceeds to a process of searching for an acquired image that satisfies the address book storage condition for storing in association with the reception information including the partner identification information (step C6). ). That is, by searching for “acquisition date / time” in the image storage unit M4 (step C6), the date / time information stored in the reception information storage unit M3 this time is acquired within a predetermined time (for example, 2 minutes). It is checked whether there is an image (step C7). In other words, whether or not information is received within a predetermined time after the image acquisition is checked based on whether or not an image acquired within a predetermined time after the current reception date is stored.

  As a result, if the corresponding acquired image is stored (YES in step C7), the process proceeds to a process of analyzing the acquired image assuming that the address book storage condition is satisfied (step C8). On the other hand, if there is an image that is currently displayed (YES in step C5), it is determined that the address book storage condition is satisfied, and the process proceeds to a process of analyzing the acquired image (step C8). Here, as a result of analyzing the acquired image, it is checked whether or not a person is included in the acquired image (step C9). If a person is included (YES in step C9), the address book storage condition is satisfied. As a matter of fact, the process proceeds to a process of converting the received information into address book data (step C10). In this case, the received information is converted into address book data by extracting "name", "phone number", "email address", "address", etc. as item data constituting the address book data from the received information. .

  Conversely, the received information is converted into address book data by deleting items other than the item data constituting the address book data. In order to associate the received information thus converted with the acquired image, an “image ID” of the image read from the image storage unit M4 is added to the converted received information, thereby adding an image-attached address associated with the acquired image. Book data is generated and additionally stored or overwritten in the address book storage unit M5 (step C11). Then, the process proceeds to the next step C12. If the camera function is activated, the camera function is terminated, and the process returns to the flow of FIG.

  On the other hand, if the acquired image is not stored in a time zone that is a predetermined time after the reception date and time of this information (NO in step C7), or the acquired image includes a person as a result of analysis. If not (NO in step C9), it is determined that the address book storage condition is not satisfied, and the process proceeds to the next step C13. If the camera function is not activated, this camera function is activated. Then, the “person mode” is set (step C14). In this case, regardless of the “setting flag” in the shooting information storage unit M6, various shooting parameters associated with the “person mode” are “ Auto focus, auto flash, shutter speed, aperture value, white balance,... Are read out and set in the imaging unit 17.

  In this state, in response to the shutter key operation on the operation unit 19, when the image capturing unit 17 performs image capturing according to the capturing mode (step C15), the date and time information is acquired from the RTC 21 (step C16). This date / time information is stored in the image storage unit M4 as an image file together with the photographed image (step C17). Thereafter, as in the case where the address book storage condition is satisfied, the received information is converted into address book data (step C10), and then the address book data with an image in which the converted received information is associated with the acquired image is generated. Then, it is stored in the address book storage unit M5 (step C11).

  In the description of the information storage process described above, the case where the reception information and the acquired image exist in a one-to-one relationship has been described. However, a plurality of images are sequentially acquired and stored in the image information storage unit M4. In this state, even when information transmitted from the information / image sharing device 6 or the external device (other mobile phone) 2 is sequentially received, the information storage processing is basically the same as described above. The individual received information is sequentially designated according to the reception order on the condition that it is an image acquired within a time period that goes back a predetermined time (for example, 2 minutes) from the information reception date and time, and each acquired image is The designated information and the image are associated with each other and stored in the address book storage unit M5 while being sequentially designated according to the acquisition order.

  On the other hand, if an incoming call is detected (YES in step A12 in FIG. 7), the process proceeds to a call process for enabling a call (step A13). If the power-off operation is performed (YES in step A14), the process proceeds to power-off processing (step A15). If any other operation is performed (YES in step A16), for example, the camera is activated. The process proceeds to a setting process for setting shooting information or setting the contents of the address book storage unit M5, a calling process, and other operations according to other operations (step A17). Thereafter, the process returns to step A3.

  As described above, in the embodiment, it is determined whether or not the storage condition for storing the reception information and the acquired image in association with each other is satisfied. If the storage condition is satisfied, the reception information and the acquisition image are associated with each other. Therefore, the operation for associating them becomes unnecessary and the operability can be greatly improved.

  Also, as a result of determining the contents of the received information, if the other party identification information is included, it is determined that the storage condition is satisfied, so the information including the other party identification information (for example, the other party's profile data) is received. In addition, it is possible to store the received information and the acquired image in association with each other as having received the information to be stored.

  As a result of determining the content of the acquired image, if the person is included, it is determined that the storage condition is satisfied. For example, if the received information is the profile data of the other party, the person of the acquired image is included. For example, it is possible to store the acquired image including the person and the reception information in association with each other as an image obtained by photographing the other party.

  Since it is determined that the storage condition is satisfied when the acquired image is being displayed, the received information and the image being displayed when the information is received can be stored in association with each other. For example, when profile data is received while an image is displayed, it can be stored in association with the image and profile of the same person.

  If it is information reception within a predetermined time from the acquisition time of the image, it is determined that the storage condition is satisfied, so that the reception information and the acquisition image are determined as having a strong relationship between the acquisition image and the reception information. It can be stored in association with each other.

  If it is an image acquisition within a predetermined time from the reception time of information, it is determined that the storage condition is satisfied, so that the received information and the acquired image are determined as having a strong relationship between the acquired image and the received information. It can be stored in association with each other.

  When a plurality of pieces of information are sequentially received and a plurality of images are obtained sequentially, the received individual information is designated in the order received, and the obtained individual images are designated in the order obtained. Since the specified information and images are stored in correspondence with each other while specifying, for example, even when profile data is received sequentially from multiple people or each person is taken sequentially, the correspondence Each received information and the acquired image can be stored in association with each other without breaking the relationship.

  Since the image captured by the imaging unit 17 is acquired, the received information and the captured image can be stored in association with each other appropriately.

  Since the image transmitted from the information / image sharing device 6 or the external device (another mobile phone) 2 is received and acquired, the received information and the received image can be stored in association with each other appropriately.

  It is determined whether to activate the camera function based on the content of the received information, and when the camera function is activated, the received information is stored in association with the captured image. The camera function can be activated and the images can be acquired, and they can be stored in association with each other without performing operations for associating them, which can greatly improve operability. It becomes.

  As a result of determining the contents of the information, if the other party identification information is included, the camera function is activated. For example, if the received information is the profile data of the other party, the camera function is activated and the other party is photographed. Images can be acquired.

  When the camera function is activated, shooting information suitable for shooting a person is set, so that shooting that is suitable for shooting a person is possible without any special operation. Images can be obtained immediately.

  In the above-described embodiment, as shown in FIG. 9, the address book storage condition is not satisfied unless an image acquired within a time period that is a predetermined time after the reception date and time of the current information is stored. The camera function is forcibly activated to start shooting in “Portrait mode”. Instead of such forced shooting, the received information is stored in the address book data without associating it with the image of the other party. The received information may be stored in the address book storage unit M5 after conversion. In this case, “name”, “phone number”, “email address”, “address”, etc. are extracted from the received information as item data constituting the address book data, or conversely, the address book data is constituted. After converting received information into address book data by deleting items other than item data, only the converted received information may be stored as address book data in the address book storage unit M5.

  In the flowchart of FIG. 9, the camera function is forcibly activated if there is no corresponding image as a result of determining whether there is an image acquired within a predetermined time from the information reception time. More simply, when the other party identification information is included in the received information, the camera function is activated, and when the other party identification information is not included, the camera function is not activated and the flow of FIG. Processing) may be terminated.

  In the above-described embodiment, when the image is stored as the address book data, the photographed image is stored as it is. However, for example, by performing an image processing process, only a person part is cut out or a predetermined size is stored. For example, the image may be reduced to an appropriate image as address book data.

In the embodiment described above, it is determined whether or not the partner identification information is included by analyzing the content of the information. For example, additional information added to the information (header information, identification ID, etc.) Based on the above, any discriminating method may be used such as discriminating whether or not the information (profile data or the like) includes partner identification information.
Similarly, in the above-described embodiment, it is determined whether or not a person is included by analyzing the content of the image. For example, based on additional information (title, shooting mode, etc.) added to the image. Any discriminating method may be used, such as discriminating whether a person is included or an image.

In addition, the address book storage conditions are “the person is included in the image”, “the identification information is included in the information”, “the information is received while the image is displayed”, “the information is received within a predetermined time after the image is acquired”, “the information Only one of “acquire an image within a predetermined time after reception” may be used.
In the above-described embodiment, the received information is the partner profile, news, and weather, but may be arbitrary data such as e-mail. In the above-described embodiment, the received information (the other party's profile data) and the acquired image (the other party's captured image) are associated with each other and stored in the address book storage unit M5. In this case, an image obtained by photographing the sky pattern at that time may be acquired, and the received information (weather) and the acquired image (sky pattern) may be associated with each other and stored in the weather database. Similarly, when the received information is news, an image related to the news may be received and acquired, and the information and the image may be associated with each other and stored in the news database.

  In the embodiment described above, the present invention is applied to the folding-type mobile phone 1, but it may be an arbitrary housing structure such as a straight type, a slide type, or a spin top type, and examples of the style include a closed style and an open style. However, any style according to the housing structure may be used.

  In the above-described embodiment, the mobile phone 1 is exemplified as the terminal device. However, the present invention is not limited to this, and for example, any communication terminal device such as a personal computer, a PDA, a digital camera, a music player, or a multifunction device thereof may be used. Also good. Further, the external device is not limited to the mobile phone 2 and may be any external device having a communication function such as a wristwatch 2, a personal computer, a PDA, a digital camera, a music player, or a multifunction device thereof.

  The “apparatus” and “machine” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

1 Mobile phone 2 External device (other mobile phone)
DESCRIPTION OF SYMBOLS 3 Wireless communication network 4 Internet 5 Information delivery apparatus 11 Central control part 13 Memory | storage part 14 Wireless communication part 16 Short-distance communication part 17 Imaging part 18 Display part 19 Operation part M1 Program memory | storage part M3 Reception information memory | storage part M4 Image memory | storage part M5 Address Book storage unit M6 Shooting information storage unit M7 Information determination condition storage unit M8 Image determination condition storage unit

Claims (7)

Receiving means for receiving information;
An acquisition means for acquiring an image;
Image content determination means for determining the content of the image acquired by the acquisition means;
Control means for storing the information received by the receiving means in the storage means in association with the image acquired by the acquiring means when the image content determining means determines that the image content includes a person;
An image pickup means for picking up an image,
The control unit operates the imaging unit when the image content determining unit determines that the image content does not include a person, and the image captured by the imaging unit and the information received by the receiving unit Are stored in the storage means in association with each other.
A terminal device characterized by that . The control means causes the image pickup means to operate in a mode suitable for photographing a person when the image content determination means determines that the image content does not include a person.
The terminal device according to claim 1 . A display determining means for determining whether or not the image acquired by the acquisition means is being displayed;
The control unit determines that the image is being displayed by the display determining unit, and the receiving unit determines that the image content determining unit determines that the content of the displayed image includes a person. Storing the information received by the storage means in association with the image being displayed,
The terminal device according to any one of claims 1 and 2 . Further comprising presence determination means for determining whether or not there is an image acquired by the acquisition means within a predetermined time from the time the information is received by the reception means;
The control unit determines that the image acquired by the presence determination unit within a predetermined time is present, and the reception unit determines that the content of the image includes a person by the image content determination unit. Storing the information received by the storage means in association with the image,
The terminal device according to any one of claims 1 and 2 . Receiving means for receiving information;
An acquisition means for acquiring an image;
Image content determination means for determining the content of the image acquired by the acquisition means;
Control means for storing the information received by the receiving means in the storage means in association with the image acquired by the acquiring means when the image content determining means determines that the image content includes a person;
A display determining means for determining whether or not the image acquired by the acquiring means is being displayed,
The control unit determines that the image is being displayed by the display determining unit, and the receiving unit determines that the image content determining unit determines that the content of the displayed image includes a person. Storing the information received by the storage means in association with the image being displayed,
A terminal device characterized by that. Computer
Receiving means for receiving information,
Acquisition means for acquiring images,
Image content determination means for determining the content of the image acquired by the acquisition means;
Control means for storing, in the storage means, the information received by the receiving means in association with the image acquired by the acquiring means when the image content determining means determines that the image content includes a person ;
A program that functions as an imaging unit that captures an image,
The control unit operates the imaging unit when the image content determining unit determines that the image content does not include a person, and the image captured by the imaging unit and the information received by the receiving unit Are stored in the storage means in association with each other.
Program, characterized in that. Computer
Receiving means for receiving information,
Acquisition means for acquiring images,
Image content determination means for determining the content of the image acquired by the acquisition means;
Control means for storing, in the storage means, the information received by the receiving means in association with the image acquired by the acquiring means when the image content determining means determines that the image content includes a person;
A program that functions as a display determining unit that determines whether the image acquired by the acquiring unit is being displayed,
The control unit determines that the image is being displayed by the display determining unit, and the receiving unit determines that the image content determining unit determines that the content of the displayed image includes a person. Storing the information received by the storage means in association with the image being displayed,
A program characterized by that.

Images