JP2007318208A - Image processing apparatus, image processing method, and program - Google Patents

Image processing apparatus, image processing method, and program Download PDF

Info

Publication number
JP2007318208A
JP2007318208A JP2006142469A JP2006142469A JP2007318208A JP 2007318208 A JP2007318208 A JP 2007318208A JP 2006142469 A JP2006142469 A JP 2006142469A JP 2006142469 A JP2006142469 A JP 2006142469A JP 2007318208 A JP2007318208 A JP 2007318208A
Authority
JP
Japan
Prior art keywords
image
importance
ranking
images
function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2006142469A
Other languages
Japanese (ja)
Other versions
JP4776433B2 (en
Inventor
Seiji Muramatsu
Takao Shimada
貴夫 嶋田
成治 村松
Original Assignee
Sony Ericsson Mobilecommunications Japan Inc
ソニー・エリクソン・モバイルコミュニケーションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Ericsson Mobilecommunications Japan Inc, ソニー・エリクソン・モバイルコミュニケーションズ株式会社 filed Critical Sony Ericsson Mobilecommunications Japan Inc
Priority to JP2006142469A priority Critical patent/JP4776433B2/en
Publication of JP2007318208A publication Critical patent/JP2007318208A/en
Application granted granted Critical
Publication of JP4776433B2 publication Critical patent/JP4776433B2/en
Application status is Expired - Fee Related legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus, an image processing method, and a program capable of configuring and displaying a standby display or the like comprising an important and preferable image to a user without the need for meticulous settings or the like by the user. <P>SOLUTION: A plurality of images are registered to an image database 24. An importance discrimination attached image management function 25 applies importance discrimination on the basis of an importance discrimination table to each image registered in the image database 24 and manages ranking of each image depending on the importance of each image. A collage generating function 29 of a screen display function 21 requests the importance discrimination attached image management function 25 to update the importance discrimination and the ranking in response to a prescribed trigger such as a date revision event, uses images selected from the image database 24 on the basis of the ranking after being updated in response to the update request to produce a collage of the images to be displayed on the standby display. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for selecting and combining a plurality of images from an internal memory or the like and displaying the images on a display screen.

  In the open patent publication (Patent Document 1) of JP-A-2002-152354, a set time interval or time and an image are stored in association with each other, and when the set time interval or time is reached, There has been disclosed a mobile phone that displays an associated image as a standby screen. According to the mobile phone described in this publication, the standby screen can be changed to reflect the user's preference.

JP 2002-152345 A (FIGS. 1 and 4)

  In the case of the above-described conventional technique, it is possible to add a change reflecting the user's preference to the standby screen, but the image displayed on the standby screen when the set time comes is an image designated by the user in advance. ing. For this reason, the user must set in advance in advance the selection of a favorite image and the time for which the image is displayed on the standby screen, and must perform a very complicated operation.

  In addition, when the set time is reached, the device may pick up an image at random and display it on the standby screen. In this case, an important and preferable image for the user is displayed on the standby screen. Not necessarily. Of course, it is possible to specify a plurality of images that the user likes in advance, and the device can pick up images randomly from among these images. Images etc. must be prepared in advance.

  The present invention has been proposed in view of such circumstances, and an image that can be displayed on a standby screen or the like by forming an image that is important and preferable for the user without requiring detailed settings or the like by the user. It is an object to provide a processing device, an image processing method, and a program.

  An image processing apparatus according to the present invention includes an image database unit that registers a plurality of images, and determines the importance of each image registered in the image database unit, and ranks each image according to the importance of each image. The image management unit to be managed and selected from the image database unit based on the ranking after the image management unit has updated the image management unit in response to the update request in response to a predetermined trigger. By using an image and an image composition unit that composes an image to be displayed on a predetermined display screen, the above-described problems are solved.

  The image processing method of the present invention includes a step of determining importance for each image registered in the image database unit, a step of managing ranking of each image according to the importance of each image, Using the step of requesting an update of the ranking according to the trigger, the step of selecting an image from the image database unit based on the ranking after being updated according to the update request, and the image selected from the image database And a step of synthesizing an image to be displayed on a predetermined display screen.

  The image processing program of the present invention determines an importance level for each image registered in the image database unit, and manages an image management unit that manages ranking of each image according to the importance level of each image, The image management unit is requested to update the ranking in response to the trigger, and the image selected from the image database unit based on the ranking updated by the image management unit in response to the update request is used to display a predetermined display screen. The above-described problem is solved by causing the information terminal to function as an image combining unit that combines the images to be displayed above.

  That is, according to the present invention, the ranking of each image is determined according to the importance of each image registered in the image database unit, the ranking is updated according to a predetermined trigger, and the update is performed. Since an image to be displayed on a predetermined display screen is synthesized using an image selected from the image database unit based on the ranked ranking, the user is required to create a detailed image for generating a synthesized image consisting of important images. There is no need to make settings.

  In the present invention, since an image to be displayed on a predetermined display screen is synthesized using an image selected based on the ranking updated in response to a predetermined trigger, the user does not perform fine setting or the like. However, it is possible to display a standby screen composed of images that are important and preferable for the user.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  In the following description, a cellular phone terminal is taken as an example as an embodiment to which the image processing apparatus, the image processing method, and the program of the present invention are applied. However, the contents described here are merely examples. Needless to say, the present invention is not limited to this example, and can be applied to various portable terminals such as PDAs (Personal Digital Assistants) equipped with a camera module, a wireless communication module, and the like.

[Schematic configuration of mobile phone terminal]
FIG. 1 shows a schematic configuration of a main part of a mobile phone terminal as an embodiment to which the present invention is applied.

  In the mobile phone terminal of the present embodiment shown in FIG. 1, the input unit 11 generates a key device on which a user performs operation input, such as a numeric keypad, a cross key, and a power key, and an operation input signal corresponding to the operation of each key. It consists of an operation signal generation circuit and the like.

  The display unit 12 includes, for example, a display composed of a liquid crystal device, an image processing circuit that performs processing of an image displayed on the display, a drive circuit for the display, a frame buffer that temporarily stores display image data on the display, and the like. Become.

  The wireless communication unit 15 includes a communication antenna and a communication circuit. The communication antenna is, for example, a built-in antenna, and transmits and receives signal radio waves for packet communication such as telephone calls and e-mails with a base station of a mobile phone network. The communication circuit performs frequency conversion, modulation, demodulation, and the like of transmission / reception signals.

  The voice processing unit 13 decodes the call voice data supplied from the wireless communication unit 15 and sends the decoded call voice data to a speaker (not shown). In addition, the voice processing unit 13 encodes call voice data supplied from a microphone (not shown) and sends the encoded data to the wireless communication unit 15.

  The timer 14 generates time information of date, date and time, and sends the time information to the CPU 10.

  The camera control unit 16 controls a camera module (not shown) and performs various operation controls such as shutter control, exposure control, white balance control, and focus control when an image is taken in the camera module.

  The secondary storage unit 18 is, for example, a large-capacity semiconductor memory or a built-in HDD. For example, image data captured by a camera module, image data received through e-mail, image data or music data downloaded through a network such as the Internet, Stores various large-capacity data such as program data.

  The memory 17 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM is an OS (Operating System), control program code for the CPU 10 to control each unit, various initial setting values, font data, dictionary data, various sound data such as ringtones and key operation sounds, and image processing of the present invention. Stored are an image automatic configuration program code which is a program, program codes for various applications installed in the terminal, device identification information (ID) of the terminal, and the like. This ROM includes a rewritable ROM such as NAND-type flash memory (NAND-type flash memory) or EEPROM (Electrically Erasable Programmable Read-Only Memory), e-mail data, telephone book and e-mail address book data, Various data related to communication such as schedule book data, communication history, communication charges, etc., dictionary data, sound data, and other various user setting values can be stored. The RAM stores data as needed as a work area when the CPU 10 performs various data processing.

  The CPU 10 performs various controls of the mobile phone terminal according to the present embodiment based on the OS and various programs stored in the memory 17, executes the automatic image configuration program according to the present embodiment, and other application programs. And so on.

  In addition, although not shown in FIG. 1, the mobile phone terminal according to the present embodiment includes each of the general mobile phone terminals such as an infrared communication function, an electronic wallet function, a GPS function, a battery, and a power control function. It also has components.

[Description of functions when executing the automatic image composition program]
FIG. 2 shows a block diagram of software functions when the CPU 10 of the mobile phone terminal of the present embodiment executes the image automatic configuration program according to the present invention, and an example of data used by the software functions.

  In FIG. 2, the image capturing function 26 controls the operation of the camera control unit 16 in FIG. 1, thereby executing an image capturing process by a camera module mounted on the mobile phone terminal. The image data obtained by the image capturing process by the image capturing function 26 is stored in the image database 24 in the secondary storage unit 18 of FIG. 1 via the image management function 25 with importance determination.

  The mail transmission / reception management function 27 includes an electronic mail transmission / reception process through the wireless communication unit 15 in FIG. 1, an electronic mail browsing process through the browse function 30 of the screen display function 21, and an email in the memory 17 in FIG. Data management in the data storage area 28 is executed. If an image file is attached to the e-mail received via the mail transmission / reception management function 27, the data of the image file is stored in the image database 24 via the image management function 25 with importance determination. The

  The image management function 25 with importance determination performs image database management such as storage and reading of image data in the image database 24. As will be described in detail later, the image management function 25 with importance determination determines whether or not each image stored in the image database 24 is, for example, an important and preferable image for the user and its management. Then, a ranking list is created / updated / managed based on the importance determination of the images.

  The screen display function 21 executes the entire display process on the display of the display unit 12.

  The browse function 30 is included in the screen display function 21, and displays an email to be transmitted / received on the display of the display unit 12 in FIG. 1 in cooperation with the mail transmission / reception management function 27.

  The collage creation function 29 is included in the screen display function 21. For example, when the mobile phone terminal according to the present embodiment enters the incoming call waiting state, the collage creation function 29 performs processing for configuring a standby screen displayed on the display of the display unit 12. Do. As will be described in detail later, the collage creation function 29 selects images based on the ranking list from images stored in the image database 24 when the standby screen is configured. For example, a standby screen is generated in which the processed images are arranged in a layout as described with reference to FIGS.

  The display image list storage area 22 in the memory 17 of FIG. 1 stores a list of display images when the collage creation function 29 forms a standby screen.

  The collage registration image list storage area 23 in the memory 17 of FIG. 1 stores a list of images constituting the current standby screen.

[Configuration example of standby screen]
The mobile phone terminal according to the present embodiment has a function of displaying a standby screen having a layout configuration in which a plurality of images are arranged on the display of the display unit 12 as shown in FIGS. It has.

  That is, in the present embodiment, for example, as shown in FIG. 3, a first layout configuration in which four images of frames F1 to F4 can be arranged in one screen, or in one screen as shown in FIG. A second layout configuration capable of arranging nine images of frames F1 to F9, and a third layout configuration capable of arranging 20 images of frames F1 to F20 in one screen as shown in FIG. The screen can be displayed on the display.

  In the present embodiment, which of the first to third layout configurations is used is determined by automatic selection by the screen display function 21 (specifically, the collage creation function 29) or by arbitrary selection by the user. Furthermore, the user can set in advance whether to use automatic selection by the screen display function 21 or arbitrary selection by the user.

  Here, in the mobile phone terminal of the present embodiment, when the automatic selection of the layout configuration is set, the image display function 21 is based on the number of registered image files in the image database 24. To automatically select which of the third layout configurations to use. That is, the screen display function 21 automatically selects the first layout configuration when, for example, the number of registered image files in the image database 24 is 0 to 8 and the image database 24 When the number of registered image files is between 9 and 19, the second layout configuration is automatically selected. When the number of registered image files in the image database 24 is 20 or more, The third layout configuration is automatically selected.

  More specifically, the collage creation function 29 of the screen display function 21 sets the layout configuration to the first layout configuration when the number of registered image files in the image database 24 is 0 to 8. The four images selected from the registered image file of the image database 24 are arranged in the four frames F1 to F4 in the first layout configuration. In addition, when there are only 0 to 3 image files registered in the image database 24 and a frame in which the registered image file cannot be arranged is generated, the collage creation function 29 performs the process for the frame. A default image prepared in advance is arranged. That is, when the first layout configuration is selected, the collage creation function 29, for example, when the number of registered images in the image database 24 is zero, the first layout configuration is selected. All the images in the frames F1 to F4 are set as default images for initial setting. For example, when the number of registered images in the image database 24 is one, the collage creation function 29 arranges the one registered image in one frame automatically selected from the first layout configuration. The default images are placed in the remaining three frames. Also, for example, when the number of registered images in the image database 24 is two, the collage creation function 29 arranges the two registered images in two frames automatically selected from the first layout configuration. The default images are placed in the remaining two frames. For example, when the number of registered images in the image database 24 is 3, the collage creation function 29 arranges the three registered images in three frames automatically selected from the first layout configuration. The default image is placed in the remaining one frame. The default image may be a background image originally drawn in the layout configuration or may be an image prepared separately. On the other hand, when the number of registered images in the image database 24 is four, the collage creation function 29 places these four image files in the frames F1 to F4 of the first layout configuration. Further, for example, when the number of image files registered in the image database 24 is 5 to 8 and the number of frames is larger than the number of frames of the first layout configuration, the collage creating function 29 The four image files automatically selected from the above are arranged in the frames F1 to F4 having the first layout configuration.

  Next, when the number of registered image files in the image database 24 increases from 8 to 9, the collage creation function 29 automatically changes the layout configuration from the first layout configuration to the second layout configuration. change. Then, the collage creation function 29 automatically selects and arranges the image files registered in the image database 24 in the frames F1 to F9 in the second layout configuration. That is, when the second layout configuration is selected and the number of registered images in the image database 24 is nine, the collage creation function 29 converts the nine image files into the second layout. It arrange | positions to each flame | frame F1-F9 of a structure. Also, for example, when the number of registered images in the image database 24 is 10 to 19 and is larger than the number of frames in the second layout configuration, the collage creation function 29 automatically selects from these image files. The nine selected image files are arranged in frames F1 to F9 having the second layout configuration.

  Next, when the number of registered image files in the image database 24 increases from 19 to 20, the collage creation function 29 automatically changes the layout configuration from the second layout configuration to the third layout configuration. change. Then, the collage creation function 29 automatically selects and arranges the image file registered in the image database 24 in each of the frames F1 to F20 in the third layout configuration. That is, when the third layout configuration is selected and the number of registered images in the image database 24 is 20, the collage creation function 29 converts the 20 image files into the third layout. It arrange | positions to each flame | frame F1-F20 of a structure. For example, when the number of registered images in the image database 24 is 21 or more and the number of frames is larger than the number of frames in the third layout configuration, the collage creation function 29 automatically selects from these image files. These 20 image files are arranged in frames F1 to F20 having the third layout configuration.

  The arrangement of each frame in the layout configuration may be determined in advance or may be randomly changed.

  In the above-described example, the first layout configuration is used when the number of registered image files in the image database 24 is 0 to 8, and the number of registered image files in the image database 24 is changed from 8 to 9. When the number increases, the first layout configuration is automatically changed to the second layout configuration, and when the number of registered image files in the image database 24 increases from 19 to 20, the second layout configuration In this example, the first layout configuration is automatically changed to the third layout configuration. As another example, when the number of registered image files in the image database 24 is from 0 to 4 or less, the first layout configuration is used. The layout configuration is automatically selected, and when the number of registered image files in the image database 24 is between 5 and 9, the second layout configuration is automatically selected and the image Image file registration number in the database 24 may automatically select the third layout configuration when at least 10 sheets. That is, when the number of registered image files in the image database 24 increases from 4 to 5, the layout configuration is automatically changed from the first layout configuration to the second layout configuration, and the image When the number of registered image files in the database 24 increases from 9 to 10, the layout configuration may be automatically changed from the second layout configuration to the third layout configuration. In this case, for example, when the number of registered images in the image database 24 is small with respect to the number of frames of the selected layout configuration and a frame in which a registered image file cannot be arranged occurs, a collage creation function In 29, a default image similar to the above prepared in advance may be arranged for the frame.

  Thus, according to the mobile phone terminal of the present embodiment, the layout configuration of the standby screen is automatically changed according to the number of registered images and the change in the number of registered images.

  In the present embodiment, the images arranged in each frame of the first to third layout configurations are the collages based on a ranking list described later from images stored in the image database 24. The creation function 29 is the selected image. In this embodiment, the collage creation function 29 randomly arranges each image selected based on the ranking list in each frame of the layout configuration. Further, the collage creation function 29, when randomly placing each of the selected images in each frame, trims the image according to the size, shape, etc. of each placed frame, reduces, enlarges, Rotate and place. FIG. 6 shows a specific example of a standby screen when an image selected based on a ranking list, which will be described later, is trimmed or the like and arranged in the frames F1 to F20 of FIG. 5 which is the third layout configuration. An example is shown. Note that, for an image that has been laid out once, after that, if the image is out of the ranking list, the image selected based on the new ranking list is placed in the frame where the image was placed.

[Image importance determination]
Here, in the present embodiment, the screen display function 21 and the collage creation function 29 are provided with the importance level determination when placing an image in each frame of the layout configuration as shown in FIGS. By selecting an image from the image database 24 based on a ranking list corresponding to the importance of the image managed by the image management function 25, the image management function 25 automatically includes a plurality of images that are important and preferable for the user. The standby screen can be displayed on the display.

  As described above, in order to construct a standby screen composed of images that are important and preferable for the user, in this embodiment, first, for example, an image management function 25 with an importance level determination is used to store an image captured by the image capturing function 26 in the image database 24. When the image is registered, when an image is attached to an e-mail transmitted / received by the mail transmission / reception management function, or when an image is downloaded via the Internet or the like, the importance of the image is determined.

  Specifically, the image management function 25 with importance determination, for example, when a new captured image is registered, when an image is attached to a transmission email, when an image is attached to a reception email, When the size is a predetermined size or more (for example, 640 × 480 pixels or more), the importance of each image is determined according to the importance determination table as shown in FIG.

  Here, according to the importance determination table shown in FIG. 7, for example, when the image size is 649 × 480 pixels or more, “+1” is added to the importance value and the attribute flag is set to “04”. Also, for example, “+2” is added to the importance value for the attached image of the received mail, and its attribute flag is set to “03”. For example, “+3” is added to the importance value for the attached image of the outgoing mail. And the attribute flag is set to “02”, and for example, for an image whose registration date is within the latest one week, “+4” is added to the importance value and the attribute flag is set to “01”. Is stipulated.

  Therefore, for example, when an image captured today by the image capturing function 26 is registered with the file name “user image 01.jpg”, if the size of the image is 1280 × 960 pixels, the importance determination The attached image management function 25 validates the attribute flags “01” and “04” for the image file of the “user image 01.jpg” based on the importance determination table of FIG. It is assumed that “3 + 1 = 4”. Then, the image management function with importance determination 25 sets information of each item in the management table relating to the image file of the “user image 01.jpg”, for example, as shown in FIG. That is, in this example, the update registration date / time is set in the management table related to the image file of “user image 01.jpg”, and “01” and “04” among the attribute flags “01” to “04”. 04 ”is set to be effective, and the importance value is set to“ 4 ”.

  Note that the importance determination table in FIG. 7 is an example, and the number and type of items in the table can be arbitrarily set by the user, and the importance value in the table can be arbitrarily changed by the user. It has been. As another example of the above table, for example, the importance of an image with a large number of colors, an image with a high contrast, an image with a lot of skin color is set high, the sky blue or orange, the green of the meadow, the red or yellow of the flower It is also possible to set a high importance level for images with strong primary colors, such as images with face recognition, images close to a specific composition (portrait composition, etc.), images close to a specific color scheme, and the number of views Images with a lot of images, images that match the template when the user or terminal selected (switched), images that have undergone face authentication and filtering that sorts colors, primary colors, and composition, series with specific similarities It is also possible to set the importance of an image (for example, a flower image) that can be made high. On the other hand, for example, an image with a white front surface (for example, an image obtained by shooting a timetable or a memo paper) or an image having similar contents can be set to a low degree of importance.

  FIG. 9 shows a processing flow (sequence diagram) of the image capturing function 26 and the image management function 25 with importance determination when the captured image by the image capturing function 26 is registered in the image database 24.

  In FIG. 9, the image capturing function 26 captures an image through the camera control unit 16 in step S10, and then registers the captured image in the image database 24 in step S11. Request to 25.

  Upon receiving a registration request for a captured image from the image capturing function 26, the image management function 25 with importance determination determines the importance of the captured image with reference to the importance determination table of FIG. Calculate the degree. After that, the image management function 25 with importance determination sets a management table relating to the file of the photographed image and registers the photographed image file in the image database 24 in step S13.

  Further, for example, when a mail with an image file attached is received today by the mail transmission / reception management function 27 and the attached image file of the received mail is registered, the size of the image is, for example, 320 × 240 pixels. Then, the image management function 25 with importance determination makes the attribute flags “01” and “03” valid for the image file based on the importance determination table of FIG. 7, and the importance value is “3 + 2 = 5 ”. Then, the image management function with importance determination 25 sets information of each item of the management table related to the image file in the same manner as described above, and registers it in the image database 24.

  FIG. 10 shows a processing flow (sequence diagram) of the mail transmission / reception management function 27 and the image management function 25 with importance determination when the image attached to the received mail is registered in the image database 24.

  In FIG. 10, the mail transmission / reception management function 27 receives a mail with an image attached via the wireless communication unit 15 of FIG. 1 in step S21, and then sends the attached image to the image database 24 in step S22. To the image management function 25 with importance determination.

  Upon receiving the attached image registration request from the mail transmission / reception management function 27, the image management function with importance determination 25 refers to the importance determination table of FIG. Calculate the importance of. That is, in the case of this example, the image management function 25 with importance determination determines the importance of an image based on information unique to the mobile phone terminal, such as mail reception. Thereafter, the image management function 25 with importance determination sets a management table relating to the file of the attached image and registers the image file in the image database 24 in step S24.

  Also, for example, when an email with an image file attached is sent in the past (from one week in the past) by the email transmission / reception management function 27 and the attached image file of the sent email is registered, the size of the image is For example, if it is 320 × 240 pixels, the image management function 25 with importance determination makes the attribute flag “03” valid for the image file based on the importance determination table of FIG. Is “3”. Then, the image management function with importance determination 25 sets information of each item of the management table related to the image file in the same manner as described above, and registers it in the image database 24.

  FIG. 11 shows a processing flow (sequence diagram) of the mail transmission / reception management function 27 and the image management function 25 with importance determination when an image registered in the image database 24 is transmitted as an attachment to a transmission mail.

  11, in step S41, the mail transmission / reception management function 27 creates a mail by the user via the input unit 11 in FIG. 1, and then attaches an image registered in the image database 24 to the mail. In S42, the image management function 25 with importance determination is requested to read the image from the image database 24.

  When receiving a request for image reading from the mail transmission / reception management function 27, the image management function 25 with importance determination performs a process of reading an image from the image database 24 and transfers the image to the mail transmission / reception management function 27 in step S45. To do.

  When receiving the image file from the image management function 25 with importance determination, the mail transmission / reception management function 27 sends the image file attached to the mail in step S43. Thereafter, in step S44, the mail transmission / reception management function 27 requests the image management function 25 with importance determination to change the importance of the image attached to the mail. That is, in the case of this example, the image management function 25 with importance determination determines the importance of an image based on information unique to the mobile phone terminal, such as email transmission.

  When the importance change request is received from the mail transmission / reception management function 27, the image management function with importance determination 25 re-imports the importance of the image in step S46 while referring to the importance determination table of FIG. The calculation and the attribute flag (“02”) are reset, and the management table for the image file is reset.

  FIG. 12 shows the management table in the case where the image management function 25 with importance determination sets information on each item of the management table related to each image based on image shooting, image attachment of sent / received mail, etc., as described above. An example is shown. The example of FIG. 12 shows a state where the management table is set for five image files “user image 01.jpg” to “user image 05.jpg”. That is, in the example of FIG. 12, the importance of “user image 05.jpg” is the highest at “4”, and the importance of “user image 02.jpg” is “2”. Both “jpg” and “user image 04.jpg” have the importance “1”, and “user image 03.jpg” has the lowest importance “0”.

[Create and update ranking list]
As described above, when the management table is set for each image file, the image management function with importance determination 25 creates a ranking list based on the importance of each image file. In the example of FIG. 12, “user image 05.jpg” with importance “4” is the highest ranking, and “user image 02.jpg” with importance “2” is second in the ranking. In the following, “User Image 01.jpg” and “User Image 04.jpg” with importance “1” are both ranked third and “User Image 03.jpg” ranking with importance “0” It becomes the lowest of.

  In the mobile phone terminal according to the present embodiment, for example, when the date is changed or when a predetermined time has passed, the mobile phone terminal is turned on when the mobile phone terminal is turned on. In the case of the type, when the terminal transitions from the closed state to the open state, or when the terminal transitions from a certain application screen to the standby screen, the above-described importance recalculation and ranking list recalculation are performed.

  That is, taking as an example a case where recalculation is performed using a date change event as a trigger, when the timer 14 in FIG. 1 detects a date change event, the image management function 25 with importance determination determines the importance determination table in FIG. Originally, for all cases of image data stored in the image database 24, the attribute flag is updated and the importance is recalculated, and the ranking list is recalculated based on the recalculated importance.

  FIG. 13 shows a processing flow (sequence diagram) of the timer 14 and the image management function 25 with importance determination when the date change event is detected from the timer 14 of FIG.

  In FIG. 13, when the timer 14 senses a date update event in step S51, the timer 14 notifies the image management function 25 with importance determination that the date update event has occurred.

  When receiving the date update notification from the timer 14, the image management function 25 with importance determination determines the importance of all the images in the image database 24 while referring to the importance determination table of FIG. And the attribute flag (“01”) are reset, the management table for all the image files is reset, and the ranking list is recalculated based on the management table.

[Reconfiguration of standby screen based on layout update and ranking update]
And, in the mobile phone terminal of the present embodiment, when the ranking list is updated in response to a predetermined trigger such as the date update event, the ranking for each image constituting the current standby screen, and the above When there is a difference between the updated ranking list, the standby screen is reconfigured using an image based on the updated ranking list.

  FIG. 14 shows a processing flow (sequence diagram) in the screen display function 21, the collage creation function 29, and the image management function 25 with importance determination when the standby screen is reconfigured based on the layout update and the ranking update. .

  In FIG. 14, when a predetermined trigger as described above occurs, the image display function 21 makes a standby screen acquisition request (collage image acquisition request) to the collage creation function 29 in step S31. .

  Upon receiving the collage image acquisition request, the collage creation function 29 requests a ranking list from the image management function 25 with importance determination in step S32.

  When receiving the request for the ranking list, the image management function 25 with a demand level determination recalculates the ranking list as described above in step S38.

  Then, in step S33, the collage creation function 29 compares the ranking for each image constituting the current standby screen with the recalculated ranking.

  If there is no difference between the two rankings, a message to that effect is returned to the screen display function 21 in step S37. Thereby, the screen display function 21 displays the standby screen as it is on the display.

  On the other hand, if there is a difference between both rankings in step S33, the collage creation function 29 determines in step S34 whether or not the layout configuration needs to be updated due to the change in the number of registered images in the image database 24.

  If it is not necessary to update the layout configuration in step S34, the standby screen is reconfigured (collage reconfiguration) using each image selected after recalculation of the previous ranking list in step S36. Thereafter, in step S37, the reconfigured standby screen is sent to the screen display function 21. Thereby, the screen display function 21 displays the reconfigured new standby screen on the display.

  On the other hand, if it is determined in step S34 that the layout configuration has been updated, the collage creation function 29 updates the layout configuration in step S35 and re-uses the previous ranking list using the updated layout. After reconfiguration of the standby screen (collage reconfiguration) using each image selected after the calculation, the standby screen after the reconfiguration is sent to the screen display function 21 in step S37. Accordingly, the screen display function 21 displays a new standby screen on which the layout configuration and the images in the layout are reconfigured on the display.

[Summary]
As described above, in the mobile phone terminal according to the present embodiment, an image having high importance for the user (for example, a large image size, a message received from a person by mail, or a recently registered image) is displayed on the standby screen with priority. Recalculation of importance triggered by date change, elapse of a certain time, power on, transition from closed to open state of terminal, transition from another application screen to standby screen, etc. The ranking list is recalculated and the image displayed on the standby screen can be automatically changed. Furthermore, according to the mobile phone terminal of the present embodiment, the layout can be automatically changed according to the number of registered images. Therefore, according to the embodiment of the present invention, it is possible to display a standby screen or the like with an image configuration that is important and preferable for the user, without the user performing fine settings. In other words, according to the present embodiment, for example, the standby screen is automatically changed only by operations such as image capturing and mail transmission / reception unique to a mobile phone terminal, and an image having high importance for the user is automatically picked up. For example, even when many images are registered, a standby screen that is meaningful to the user can be displayed, and the layout is automatically changed according to the number of images, and appropriate display according to the number of registered images becomes possible. As a result, the user can enjoy the change of the standby screen. In addition, according to the present embodiment, since transmission / reception of mail is added to the importance determination, it is possible to keep the topic in memory and facilitate communication between users.

  The above description of the embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiments, and various modifications can be made according to the design and the like as long as they do not depart from the technical idea of the present invention. .

  For example, it is possible to randomly multiply the number of points according to the ranking by a weighting coefficient (weighting coefficient with respect to the probability of ranking) so that the lower ranks are sometimes arranged on the standby screen. .

  Further, the size of each image frame to be laid out and its position (a conspicuous position) may be determined according to the importance of the image.

  Further, the layout of the standby screen may be a layout such as an image in which a photograph is pasted on a cork board, for example, in addition to the images arranged without gaps as in the examples of FIGS.

  In addition, when trimming an image according to the size and shape of the frame, in addition to simply performing trimming to fit the frame with the center of the image in the middle, the face can be identified by face authentication, for example Alternatively, the face portion may be trimmed.

  Further, when an image unnecessary for the user is arranged in each image laid out on the standby screen, the unnecessary image may be designated and deleted, and a new collage may be created. If such operations are repeated, the remaining images become images that are important to the user, thereby learning what the images that are important to the user look like, and reflecting the learning results in ranking calculations, etc. Also good.

  In addition, it is also possible to capture the collage standby screen as described above and transmit it by attaching it to e-mail, for example.

It is a block diagram which shows schematic structure of the principal part of the mobile telephone terminal of this invention embodiment. It is a figure which shows an example of the structure of a software function when CPU of the mobile telephone terminal of this embodiment runs the image automatic structure program concerning this invention, and the data which the said software function uses. It is a figure which shows the 1st layout structure which can arrange | position four images in 1 screen. It is a figure which shows the 2nd layout structure which can arrange | position nine images in 1 screen. It is a figure which shows the 3rd layout structure which can arrange | position 20 images in 1 screen. It is a figure which shows an example of the standby screen by which the image is arrange | positioned at the 3rd layout structure. It is a figure which shows an example of an importance determination table. It is a figure which shows an example of the management table regarding the image file of the said "user image 01.jpg" at the time of registering the image image | photographed today with the file name of "user image 01.jpg". FIG. 10 is a sequence diagram illustrating a processing flow of an image capturing function and an image management function with importance determination when a captured image is registered in an image database. It is a sequence diagram which shows the processing flow of the mail transmission / reception management function and the image management function with importance determination when the image attached to the received mail is registered in the image database. It is a sequence diagram showing a processing flow of a mail transmission / reception management function and an image management function with importance determination when an image is attached to a transmission mail and transmitted. It is a figure which shows an example of the said management table when the image management function with importance determination sets the information of each item of the management table regarding each image based on image photography, the image attachment of transmission / reception mail, etc. It is a sequence diagram which shows the processing flow of the image management function with a timer and importance determination, when a date change event is detected. It is a sequence diagram showing a processing flow in a screen display function, a collage creation function, and an image management function with importance determination when a standby screen is reconfigured based on layout update and ranking update.

Explanation of symbols

  10 CPU, 11 input unit, 12 display unit, 13 audio processing unit, 14 timer, 15 wireless communication unit, 16 camera control unit, 17 memory, 18 secondary storage unit, 21 screen display function, 22 display screen list storage area, 23 Current collage registration image list storage area, 24 image database, 25 Image management function with importance determination, 26 Image shooting function, 27 Mail transmission / reception management function, 28 Mail data storage area, 29 Collage creation function, 30 Browse function

Claims (5)

  1. An image database section for registering a plurality of images;
    An image management unit that determines the importance of each image registered in the image database unit and manages the ranking of each image according to the importance of each image;
    In response to a predetermined trigger, the image management unit is requested to update the ranking, and the image selected from the image database unit based on the ranking after the image management unit is updated in response to the update request is used. An image composition unit for compositing an image to be displayed on a predetermined display screen;
    An image processing apparatus comprising:
  2.   The image processing apparatus according to claim 1, wherein the image synthesis unit determines the number of images to be synthesized and the layout of each image according to the number of registered images in the image database unit.
  3.   The image processing apparatus according to claim 1, wherein the image management unit uses information unique to the apparatus for determining the importance.
  4. Determining the importance of each image registered in the image database unit;
    Managing the ranking of each image according to the importance of each image;
    Requesting an update of the ranking in response to a predetermined trigger;
    Selecting an image from the image database unit based on the ranking after being updated in response to the update request;
    Synthesizing an image to be displayed on a predetermined display screen using an image selected from the image database;
    An image processing method comprising:
  5. An image management unit that determines the importance of each image registered in the image database unit, and manages the ranking of each image according to the importance of each image,
    In response to a predetermined trigger, the image management unit is requested to update the ranking, and the image selected from the image database unit based on the ranking after the image management unit is updated in response to the update request is used. As an image composition unit for compositing an image to be displayed on a predetermined display screen,
    An image processing program for causing an information terminal to function.
JP2006142469A 2006-05-23 2006-05-23 Image processing apparatus, image processing method, and program Expired - Fee Related JP4776433B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2006142469A JP4776433B2 (en) 2006-05-23 2006-05-23 Image processing apparatus, image processing method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2006142469A JP4776433B2 (en) 2006-05-23 2006-05-23 Image processing apparatus, image processing method, and program

Publications (2)

Publication Number Publication Date
JP2007318208A true JP2007318208A (en) 2007-12-06
JP4776433B2 JP4776433B2 (en) 2011-09-21

Family

ID=38851716

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2006142469A Expired - Fee Related JP4776433B2 (en) 2006-05-23 2006-05-23 Image processing apparatus, image processing method, and program

Country Status (1)

Country Link
JP (1) JP4776433B2 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010154453A (en) * 2008-12-26 2010-07-08 Furyu Kk Photographic sticker creating device, photographic sticker creating method, and program
KR20110080573A (en) * 2010-01-06 2011-07-13 엘지전자 주식회사 Mobile terminal and method for controlling the same
US8521230B2 (en) 2008-06-27 2013-08-27 Kyocera Corporation Mobile telephone
US9424765B2 (en) 2011-09-20 2016-08-23 Sony Corporation Image processing apparatus, image processing method, and program
JP2017526074A (en) * 2014-08-21 2017-09-07 ホアウェイ・テクノロジーズ・カンパニー・リミテッド System and method for generating a user facial expression library for messaging and social networking applications

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001092740A (en) * 1999-09-22 2001-04-06 Denso Corp Communication terminal
JP2001238168A (en) * 2000-02-23 2001-08-31 Seiko Epson Corp Digital camera
JP2003087360A (en) * 2001-09-17 2003-03-20 Hitachi Kokusai Electric Inc Mobile terminal
JP2005072958A (en) * 2003-08-25 2005-03-17 Hitachi Kokusai Electric Inc Portable terminal
JP2007019611A (en) * 2005-07-05 2007-01-25 Casio Entertainment Inc Mobile information terminal and picture generating method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001092740A (en) * 1999-09-22 2001-04-06 Denso Corp Communication terminal
JP2001238168A (en) * 2000-02-23 2001-08-31 Seiko Epson Corp Digital camera
JP2003087360A (en) * 2001-09-17 2003-03-20 Hitachi Kokusai Electric Inc Mobile terminal
JP2005072958A (en) * 2003-08-25 2005-03-17 Hitachi Kokusai Electric Inc Portable terminal
JP2007019611A (en) * 2005-07-05 2007-01-25 Casio Entertainment Inc Mobile information terminal and picture generating method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8521230B2 (en) 2008-06-27 2013-08-27 Kyocera Corporation Mobile telephone
JP2010154453A (en) * 2008-12-26 2010-07-08 Furyu Kk Photographic sticker creating device, photographic sticker creating method, and program
KR20110080573A (en) * 2010-01-06 2011-07-13 엘지전자 주식회사 Mobile terminal and method for controlling the same
KR101629313B1 (en) * 2010-01-06 2016-06-10 엘지전자 주식회사 Mobile terminal and method for controlling the same
US9424765B2 (en) 2011-09-20 2016-08-23 Sony Corporation Image processing apparatus, image processing method, and program
JP2017526074A (en) * 2014-08-21 2017-09-07 ホアウェイ・テクノロジーズ・カンパニー・リミテッド System and method for generating a user facial expression library for messaging and social networking applications

Also Published As

Publication number Publication date
JP4776433B2 (en) 2011-09-21

Similar Documents

Publication Publication Date Title
US8260352B1 (en) Communication device
US8839146B2 (en) User interface for a wireless device
CN101359334B (en) Portable terminal and image information managing method therefor
US9665597B2 (en) Method and system for processing images using time and location filters
JP4353933B2 (en) Communication apparatus and computer program
US7203521B2 (en) Method of displaying speed dials on a screen of a mobile communication terminal
US20080133697A1 (en) Auto-blog from a mobile device
US7933611B2 (en) Disabling operation of features on a handheld mobile communication device based upon location
TWI242351B (en) Camera equipped with communication function, image data memory method, and computer program
US8725206B2 (en) Disabling operation of a camera on a handheld mobile communication device based upon enabling or disabling devices
JP2009010985A (en) Reference field utilization method in mobile communication terminal device
CN100445993C (en) Method and arrangement for naming pictures to be saved in a mobile station
JP2004194293A (en) Mobile wireless terminal, photographed image editing device, and photographed image editing method
CN101127204B (en) Information processing apparatus, and information processing method
US9241056B2 (en) Image based dialing
KR101466027B1 (en) Mobile terminal and its call contents management method
US8724004B2 (en) Mobile terminal and tag editing method thereof
US7382405B2 (en) Electronic apparatus having a user identification function and user identification method
US20050071771A1 (en) Menu displaying method and communication apparatus
US7366547B2 (en) Communications apparatus that displays data in a standby screen
KR20120013299A (en) Digital photo frame with dial-a-tag functionality
KR100610558B1 (en) Electronic apparatus having a communication function and an image pickup function, image display method and recording medium for stroring image display program
CN101674409A (en) Mobile terminal having panorama photographing function and method for controlling operation thereof
US8694028B2 (en) Communication terminal apparatus and computer program
KR100733628B1 (en) Electronic device, information display method, and recording medium for storing information display program

Legal Events

Date Code Title Description
RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20071009

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20090508

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20101210

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20101228

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110221

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20110628

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20110628

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140708

Year of fee payment: 3

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees