JP2012093923A - Image display apparatus, image display method, server device and server control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display apparatus or the like which can be enjoyed not only in vision but also in hearing and further also comprises practical availability.SOLUTION: A photographic image of a photographed clock tower is converted into a pictorial image 52 (a). In the photographic image, a time display portion image 53 is recognized, a coordinate position representing a position of the recognized time display portion image 53 is stored and then, a built-in time display portion image N1 corresponding to the time display portion image 53 is selected from among a plurality of built-in time display portion images stored in a ROM beforehand. The selected built-in time display portion image N1 is pasted and combined at the coordinate position of the pictorial image 52 and then, the pasted and combined built-in time display portion image N1 is switched and displayed sequentially according to the present time. Furthermore, sounds of a chime of the photographed clock tower are downloaded from a server and at a predetermined time, the sounds of the chime are generated from a speaker 15.

Description

  The present invention relates to an image display device that displays a captured image, an image display method, a server device used therefor, and a server control method.

  2. Description of the Related Art Conventionally, there has been known a painting-like image conversion method for easily creating a painting-like image that simulates a feature seen in a painting drawn by a painter without increasing human costs and time costs.

  In this painting style image conversion method, in addition to the original image to be processed, an image of a picture drawn by an actual painter is also input, and color information and touch information are analyzed from the image of the painter. Then, based on the analyzed information, the color of the original image is simulated, and a painting style image is generated by arranging the strokes (see, for example, Patent Document 1 below).

JP 2004-213598 A

  However, in the prior art, although the generated painting-like image can be appreciated and enjoyed, that is, it can be enjoyed visually, it cannot be enjoyed auditorily.

  The present invention has been made in view of such conventional problems, and can be enjoyed not only visually but also auditorily, and also has practicality, an image display device, and an image display It is an object of the present invention to provide a method, a server device used together with these, and a server control method.

  In order to solve the above-described problem, the image display device according to the first aspect of the present invention is an image display device including a storage unit, a clock unit, a display unit, and a sound emitting unit, and a photographing unit; Image conversion means for converting a photographed image of a building photographed by the photographing means into a painting-like image, position information obtaining means for obtaining position information indicating a photographing position of the photographed image by the photographing means, and the position information Transmitting means for transmitting the position information acquired by the acquiring means to the server device, and after transmitting the position information by the transmitting means, the sound data of the bell sound generated by the building transmitted from the server device. Receiving means for receiving, storage control means for storing the sound data received by the receiving means in the storage section, and a picture-like image converted by the image converting means on the display section Under the state shown, when the current time measured by the clock unit becomes a predetermined time, the sound data is read from the storage unit, and the sound emission is based on the read sound data And control means for controlling the generation of a bell sound by the section.

  In the image display device according to the second aspect of the present invention, the image display device further includes a distance measuring unit that measures a distance from the photographing position to the position of the building, and the storage unit includes the distance measuring unit. The measured distance is further stored, and the control unit controls generation of a bell sound by the sound emitting unit at a volume corresponding to the distance stored in the storage unit.

  In the image display device according to the third aspect of the present invention, the captured image is an image of a building that generates a bell sound such as a clock tower or a temple.

  The image display device according to the invention of claim 4 is an image display device comprising a storage unit, a clock unit and a display unit, and a sound emitting unit. Position information acquisition means for acquiring position information indicating the shooting position of the captured image of the captured building, transmission means for transmitting the position information acquired by the position information acquisition means to the server device, and the transmission means for the position After transmitting the information, receiving means for receiving the sound data of the bell sound generated by the building transmitted from the server device, and storing the sound data received by the receiving means in the storage unit Under the state where the storage control means and the image photographed by the photographing means are displayed on the display section, when the current time counted by the clock section is a predetermined time, Reading the sound data from the serial memory unit, and wherein the control means further comprising a for controlling the generation of the sound of the bell by the sound emitting unit on the basis of this sound read data.

  The server device according to claim 5 is a server device connected to an external device including a clock unit, a display unit, a sound emitting unit, and a photographing unit via a network, Receiving means for receiving position information indicating the photographing position of the photographing means transmitted from an external device, and storage means for storing a plurality of sets of positional information and sound data of a bell sound generated by a building in association with each other And reading means for reading the bell sound data corresponding to the position information received by the receiving means from the storage means, and transmitting the read bell sound data to the external device. It is characterized by providing.

  In the server device according to the sixth aspect of the invention, the storage unit further stores the name of the building in association with the position information, and the transmission unit receives the reception unit. Reading the sound data of the bell sound corresponding to the position information and the name of the building from the storage means, and transmitting the read sound data of the bell sound data and the name of the building to the external device. Features.

  The server device according to claim 7 is a server device connected to an external device including a clock unit, a display unit, a sound emitting unit, and a photographing unit via a network, Receiving means for receiving a photographed image of a building photographed by the photographing means transmitted from an external device and position information indicating the photographing position, and a photographed image of the building received by the receiving means. An image conversion means for converting to a position, a storage means for storing a plurality of sets of position information and sound data of a bell sound generated by a building, and a bell corresponding to the position information received by the receiving means. Transmitting means for reading sound data of the sound from the storage means, and transmitting the read sound data of the bell sound and the painting-like image converted by the image converting means to the external device, Characterized in that it obtain.

  The image display method according to the invention of claim 8 is an image display method in an apparatus including a storage unit, a clock unit, a display unit, and a sound emitting unit, and includes a photographing step and the photographing step. An image conversion step for converting the captured image of the building imaged by the above to a painting-like image, a position information acquisition step for acquiring position information indicating the shooting position of the captured image by the shooting step, and the position information acquisition step A transmission step of transmitting the acquired position information to the server device, and a reception of receiving the sound data of the bell sound generated by the building transmitted from the server device after transmitting the position information in the transmission step A storage control step for storing the sound data received in the reception step in the storage unit; and the image conversion step. When the current time measured by the clock unit becomes a predetermined time under the state where the picture-like image converted by the above is displayed on the display unit, the sound data is stored from the storage unit. And a control step of controlling generation of a bell sound by the sound emitting unit based on the read sound data.

  The image display method according to the ninth aspect of the present invention is an image display method in an apparatus including a storage unit, a clock unit, a display unit, and a sound emitting unit. In the position information acquisition step for acquiring the position information indicating the shooting position of the captured image of the building imaged in the step, the transmission step for transmitting the position information acquired in the position information acquisition step to the server device, and the transmission step After transmitting the position information, a reception step of receiving sound data of a bell sound generated by the building transmitted from the server device, and the sound data received by the reception step in the storage unit A storage control step for storing, and a time measured by the clock unit under a state in which an image photographed in the photographing step is displayed on the display unit. A control step for reading out the sound data from the storage unit when the current time determined in advance is a predetermined time, and controlling generation of a bell sound by the sound emitting unit based on the read sound data; , Including.

  In the server device control method according to the tenth aspect of the present invention, the control of the server device connected via a network to an external device having a clock unit, a display unit, a sound emitting unit, and a photographing unit. A receiving step for receiving position information indicating a shooting position of the shooting step transmitted from the external device, and a plurality of sets of the position information and sound data of a bell sound generated by a building in association with each other A transmitting step of reading the sound data of the bell sound corresponding to the position information received in the receiving step from the storing means, and transmitting the read sound data of the bell sound to the external device; , Including.

  In the server device control method according to the invention described in claim 11, the control of the server device connected via a network to an external device having a clock unit, a display unit, a sound emitting unit, and a photographing step. A receiving step for receiving a photographed image of a building photographed in the photographing step transmitted from the external device and position information indicating the photographing position; and a method for receiving the building received by the receiving step. The position received by the receiving step from the storage means for storing an image conversion step for converting the photographed image into a painting-like image and a plurality of sets of positional information and sound data of the bell sound generated by the building in association with each other The sound data of the bell sound corresponding to the information is read, and the read sound data of the bell sound and the picture-like image converted by the image converting step are used. Characterized in that it comprises a transmission step of transmitting the Kigaibu device, the.

  According to the present invention, it is possible to provide an image display apparatus and an image display method that can be enjoyed not only visually but also auditorily, and also have practicality.

  More specifically, for example, when a building that generates a bell sound such as a clock tower is photographed, a photographed image of the photographed building can be automatically converted into a picture-like image and displayed. Under the condition that the picture-like image is displayed, the sound of the bell of the taken building can be generated when the current time counted is a predetermined time. You can know the time while associating with the building converted to the wind image.

  Alternatively, when a building that generates a bell sound such as a clock tower is photographed, a photographed image of the photographed building can be displayed and a photographed image of the photographed building is displayed. Then, when the current time measured reaches a predetermined time, the bell sound of the filmed building can be generated, and the time can be known in relation to the filmed building. it can.

(A) is a front view which shows the external appearance of the table clock concerning one embodiment of this invention, (b) is a rear view. (A) is a functional block diagram of the timepiece, and (b) is a functional block diagram of the server. (A) is a conceptual diagram of the table memorize | stored in ROM of the server, (b) is a memory block diagram of RAM of a table clock. It is a conceptual diagram of the table memorize | stored in ROM of the table clock. (A) is a flowchart showing a processing procedure on the table clock side, and (b) is a flowchart showing a processing procedure on the server side. It is a flowchart which shows the procedure of a painting style image conversion display process. (A) is a figure which shows an example of a picked-up image, (b) is a figure which shows an example of the painting style image after converting a picked-up image. It is a flowchart which shows the procedure of the recognition process of a time display part image. (A) And (b) is explanatory drawing which shows the extraction procedure of a time display part image. (A) is a figure which shows the time display part image of a digital display, (b) is a figure which shows the built-in time display part image of a digital display. (A)-(c) is explanatory drawing which shows the conversion procedure to a picture style image. It is a flowchart which shows the procedure of the information acquisition / data transmission process by the timepiece side. 4 is a flowchart showing a processing procedure on the server side, (a) is an information acquisition / data reception process, (b) is a data editing process, and (c) is a flowchart showing a data transmission process. It is a flowchart which shows the process sequence by the timepiece side, (a) is a data reception process, (b) is a flowchart which shows the process sequence of processes, such as bell sound generation | occurrence | production. The 2nd Embodiment of this invention is shown, (a) is a flowchart which shows the process sequence by the timepiece side, (b) is a flowchart which shows the process sequence by the server side. It is a flowchart which shows the procedure of the imaging | photography / display process in the table clock based on the embodiment. The third embodiment of the present invention is shown, (a) is a flowchart showing the processing procedure on the table clock side, (b) is a flowchart showing the processing procedure on the server side. It is a flowchart which shows the procedure of the imaging | photography / display process in the table clock based on the embodiment. It is a flowchart which shows the procedure of the painting style image reception and display process in the embodiment.

(First embodiment)
Hereinafter, embodiments of the present invention will be described. FIG. 1A is a front view showing the appearance of the table clock 1 according to the embodiment of the present invention, and FIG. 1B is a rear view showing the appearance of the table clock 1.

  This table clock 1 has a photographing function and a sound emitting function, a liquid crystal display unit 2 is provided in the front part, and a speaker 15 is arranged in the lower part. In addition, a lens unit 3 of an imaging unit, which will be described later, is provided on the back side, and a function key 5, a slide switch 6 and the like are provided. A shutter key 4 is provided on the upper surface.

  2A is a functional configuration diagram of the table clock 1, and FIG. 2B is a functional configuration diagram of a server (site) 500 connected to the table clock 1 via the Internet. The table clock 1 includes a CPU 7, a ROM 8 storing programs for realizing various functions of the CPU 7, an imaging unit 9, a RAM 10, an input unit 11, a divided image RAM 12, a transmission / reception unit 19, a clock unit 13, and an image composition unit 14. And a distance measuring unit 16, a GPS receiving unit 17, a sound emitting unit 18 having the speaker 15, and the liquid crystal display unit 2. Further, the CPU 7 includes a time display unit detection unit 71 that detects a time display unit image, which will be described later, and an image acquisition unit 72 that acquires a captured image. Note that the time display unit detection unit 71 and the image acquisition unit 72 function by the CPU 7 by executing a program stored in the ROM 8.

  The input unit 11 includes the shutter key 4, the function key 5, the slide switch 6, and the like, and detects user operations on these keys and switches.

  The transmission / reception unit 19 includes a transmission unit 191 that transmits data to the server 500 via the Internet, and a reception unit 192 that receives data transmitted from the server 500 via the Internet. The GPS receiver 17 receives the L1 band C / A code from the geodetic satellite, demodulates and decodes it, and determines the latitude and longitude of the current position. Information is taken into the CPU 7. The distance measuring unit 16 measures the distance from the table clock 1 having a photographing function to the photographed subject when the image capturing unit 9 images a subject such as a building.

  The divided image RAM 12 is provided with a time display unit image memory 121 and a background image memory 122. The time display unit image memory 121 stores a time display unit image included in a captured image (captured image) and stores coordinates indicating the position of the time display unit image in the captured image. The background image memory 122 stores a background image obtained by removing the time display portion image from the photographed image.

  The imaging unit 9 includes the lens unit 3 and a CCD or CMOS disposed on the optical axis of the lens unit 3, forms an object image (image) with the lens unit 3, and outputs light of each color of RGB. Image data is generated by converting the intensity into a current value. The RAM 10 stores image data captured and acquired by the imaging unit 9 and is used as a work area for the CPU 7.

  The CPU 7 executes a program stored in the ROM 8 and performs various processes independently or in cooperation with other components, thereby realizing various means, various components, and various functions of the table clock 1.

  The time display unit detection unit 71 detects the time display unit image, which is an image of the time display unit in the captured image acquired by the CPU 7 from the RAM 10. The image acquisition unit 72 acquires the image acquired by the CPU 7 and detected by the time display unit detection unit 71 by dividing the image into a time display unit image and a dial image from which the time display unit image has been removed. To do.

  The divided image RAM 12 stores the time display unit image acquired by the image acquisition unit 72 in the time display unit image memory 121, while storing the background image from which the time display unit image has been removed in the background image memory 122. The clock unit 13 that functions as a clocking unit counts the current time according to an instruction from the CPU 7.

  The image composition unit 14 functioning as a composition unit performs image composition to replace the built-in time display unit image stored in the RAM 10 generated by the CPU 7 as will be described later. The CPU 7 functioning as a display unit displays the image synthesized by the image synthesis unit 14 on the liquid crystal display unit 2 as a display unit.

  On the other hand, as shown in FIG. 2B, the server 500 includes a CPU 501, a ROM 502, a RAM 503, an input unit 504, a receiving unit 505, a transmitting unit 506, data, and the like that store programs for realizing various functions of the CPU 501. An editing unit 507 and a liquid crystal display unit 508 are provided.

  The receiving unit 505 receives data transmitted from the transmitting unit 191 of the table clock 1 via the Internet. The transmission unit 506 transmits data to the reception unit 192 of the table clock 1 via the Internet. The data editing unit 507 performs processing for editing data to be transmitted / received.

  FIG. 3A is a memory configuration diagram of the ROM 502 included in the server 500, and FIG. 3B is a memory configuration diagram of the RAM 10 included in the table clock 1. As shown in FIG. 3A, the ROM 502 of the server 500 includes a clock tower name column 521, a clock tower image column 522, a clock tower location range column 523, and a bell sound (waveform) column 524. Are provided correspondingly. The clock tower name column 521 stores the names of clock towers that exist in various parts of Japan.

  The clock tower image field 522 stores an image of the clock tower. The clock tower location range column 523 stores a range of addresses for which a building photographed within the range is determined to be a corresponding clock tower. The bell sound column 524 stores bell sound waveform data (sound data) generated by the corresponding clock tower.

  On the other hand, as shown in FIG. 3B, the RAM 10 of the table clock 1 has a clock tower name column 101, a clock tower image column 102, a clock tower location column 103, a distance table 104, and a bell. The sound (waveform) column 105 is provided correspondingly. The clock tower name field 521 stores the name of the clock tower transmitted from the server 500 based on the image captured by the imaging unit 9. The clock tower image field 102 stores the clock tower image captured by the imaging unit 9. The clock tower location field 103 stores the location of the clock tower imaged by the imaging unit 9 according to the longitude and latitude of the shooting position acquired by the GPS receiving unit 17. Further, the distance to the clock tower 104 stores the distance from the photographing position measured by the distance measuring unit 16 to the clock tower during imaging by the imaging unit 9. The bell sound (waveform) column 105 stores bell sound waveform data (sound data) generated by the corresponding clock tower downloaded from the bell sound column 524 in the ROM 502 of the server 500.

  The ROM 8 on the table clock 1 side stores a table 801 shown in FIG. This table 801 is provided with a needle type (analog) column 802 and a numeric type (digital) column 803.

  The needle type (analog) column 802 stores needle images corresponding to the ratio of the length L1 of the hour hand (H1) and the length L2 of the minute hand (H2) corresponding to the patterns 1, 2, and 3. .

  For example, the needle type (analog) pattern 1 is a needle image that displays time in a needle type in which the ratio of the minute hand length to the hour hand length “2” is “8”. Pattern 2 is a hand image that displays the time with a needle type in which the ratio of the minute hand length to the hour hand length “3” is “7”, and pattern 3 is the time hand length “4”. Thus, there is a hand image displaying the time in a hand type in which the ratio of the length of the minute hand is “6”.

  Each of the patterns 1, 2, and 3 includes a hand image of the hour hand and the minute hand having the length of the ratio, and a built-in time display portion image representing the time from 12: 0 to 11:59, that is, 12 X60 = 720 kinds of built-in time display section images for each time in minutes are stored.

  In the numeric expression (digital) column 102, numbers “00” to “23” representing hours are stored corresponding to the patterns 1, 2, 3,... 24, and the patterns 1, 2, 3,. Corresponding to 60, time images of numbers “00” to “59” representing minutes are stored. Therefore, 24 × from “00:00” to “23:59” can be obtained by combining the time images of the numbers “00” to “23” representing hours and the numbers “00” to “59” representing minutes. 60 = 1440 types of time can be represented.

  In the present embodiment having the above configuration, the table clock 1 executes the process shown in the flowchart of FIG. 5A by the CPU 7 executing the process according to the program stored in the RAM 10. That is, a photographing / painting style conversion display process (step A1), an information acquisition / data transmission process (step A2), a data reception process (step A3), and a bell sound generation process (step A4) are sequentially executed.

  Further, as shown in the flowchart of FIG. 5B, the server 500 sequentially executes information acquisition / data reception processing (step B1), data editing processing (step B2), and data transmission processing (step B3).

  FIG. 6 is a flowchart showing details of the photographing / painting style conversion display process (step A1) executed on the table clock 1 side. That is, when the user carries the table clock 1 and directs the lens unit 3 toward the clock base 50 shown in FIG. 7A and presses the shutter key 4, the CPU 7 executes a photographing process (step A11). Through this photographing process, the imaging unit 9 takes in the subject image formed by the lens unit 3 to obtain a photographed image, and stores this photographed image in the RAM 10 (step A12).

  As a result, as shown in FIG. 3B, for example, the clock tower image AG <b> 2 is stored in the clock tower image column 102 of the RAM 10.

  Subsequently, the CPU 7 drives the liquid crystal display unit 2 to display the captured image on the liquid crystal display unit 2 (step A13). As a result of the processing in step A13, a photographed image 51 having the clock tower 50 as the main subject is displayed on the liquid crystal display unit 2 as shown in FIG.

  Next, the conversion process which converts this picked-up image 51 into a picture-like image is performed (step A14). Any known conversion processing method may be used for the conversion processing of the captured image into the picture-like image in step A14.

  For example, by adopting a technique disclosed in Japanese Patent Application Laid-Open No. 2004-213598, a color and a touch of a painter image that is an image of a specific painter stored in advance in the ROM 8 are extracted, and the photographed image is extracted. 51 and converted into a picture-like image. Conversion to a painting-like image involves analyzing the direction and strength of the texture from the procedure that simulates the photographed image 51 in the color of the painter image, the procedure of extracting the stroke characteristics from the painter image, and the image that simulates the color. And a procedure for arranging the extracted brush strokes based on the analysis result.

  In the procedure for simulating colors, a representative set of colors is created from the painter image, and a representative set of colors is also created from the photographed image 51. The color set creation is to plot color information on a color space and select and use a color frequently used from all colors used in an image. By comparing the color set of the photographed image 51 with the color set of the painter image, and performing re-coloring by mimicking, the photographed image 51 is converted into a painting-like image simulating the color.

  Alternatively, the photographed image 51 may be converted into an oil-like image by using the technique disclosed in Japanese Patent Laid-Open No. 60-198687 or the technique disclosed in Japanese Patent Laid-Open No. 61-150077. The photographed image 51 may be converted into an ink-like image using the technique disclosed in Japanese Patent Laid-Open No. 61-221878.

  By the conversion process in step A14, as shown in FIG. 7B, a painting-like image 52 is generated and displayed on the liquid crystal display unit 2.

  Next, a time display part image recognition process is executed (step A15). FIG. 8 is a flowchart showing details of the time display portion image recognition processing in step A15.

  First, it is determined whether or not there is a circular image in the captured image 51 (step A21). As shown in the partially enlarged view of FIG. 9B, when there is a circular image R in the captured image 51, the determination in step A21 is YES. Accordingly, the process proceeds from step A21 to step A22, and it is determined whether there are two needle images (H1, H2) having different lengths inside the circular image.

  As shown in the partially enlarged view of FIG. 9B, when there are two needle images H1 and H2 having different lengths inside the circular image R, the determination in step A22 is YES. Accordingly, the process proceeds from step A22 to step A23, and the ratio of the two needle images H1 and H2 is calculated. Thereafter, the internal time display image of the circular image stored in the ROM 8 corresponding to the calculated ratio of the lengths of the two needle images H1 and H2 is specified.

  That is, as shown in FIG. 9B, the length of the hour hand H1 is L1, the length of the minute hand H2 is L2, and the ratio of the length L2 of the minute hand to the length L1 of the hour hand is 2: 8. If there is, this ratio corresponds to the internal time display portion image of pattern 1 in the table 801 shown in FIG. Therefore, in step A24, the internal time display part image (N1) which is this pattern 1 is specified as a time display part image to be used.

  On the other hand, if the determination in step A21 is NO and there is no circle image in the captured image, the process proceeds from step A21 to step A25 to determine whether or not there is a frame image in the captured image. As shown in FIG. 10A, when a frame image W is present in the captured image, a colon “:” is placed between the plurality of numbers S1, S2, S3 and the number inside the frame image W. It is determined whether or not there is C1 (step A26).

  In the case of the example shown in FIG. 10A, since there are a plurality of numbers S1, S2, S3 and a colon C1 between the numbers inside the frame image W, the determination in step A26 is YES. Therefore, the process proceeds from step A26 to step A27, and the built-in time display part image in the ROM 8 corresponding to the numbers S1, S2, S3, and the colon C1 is specified as the time display part image to be used. That is, in the table 801, the internal time display unit image stored in the numeric (digital) column 103 is specified as the time display unit image to be used. Thus, as shown in FIG. 10B, the built-in time display unit image M1 that digitally displays the time is determined as the time display unit image to be used.

  On the other hand, in step A16 following step A15 in the flowchart of FIG. 6, position coordinates indicating the position of the recognized time display portion image in the captured image are detected and stored in the RAM 10. At this time, the position coordinates of the time display part image are detected and stored in the position coordinates of the four points on the top, bottom, left and right of the circle image when the time display part image has a circle image (step A21; YES). If the time display portion image has a frame image (step A25; YES), the position coordinates of the four corners of the frame image are detected and stored.

  Note that only the position coordinates of the center portion of the circle image or only the position coordinates of the center portion of the frame image may be detected and stored.

  Next, based on the position coordinates stored in the RAM 10 in step A16, the time display part image of the painting-like image is replaced with the built-in time display part image specified in step A24 or step A27 (step A17). Therefore, by the processing in step A17, for example, the internal time display portion image N1 is replaced with the time display portion image 53 of the painting-like image 52 as shown in FIGS.

  Further, the picture-like image is pasted and displayed on the clock display unit, which is the upper area of the liquid crystal display unit 2, while sequentially replacing the internal time display unit image (N1) according to the current time measured by the clock unit 13 (step A18). 19). Thereby, as shown in FIG. 11C and FIG. 1A, the liquid crystal display unit 2 includes a painting style image including a time display unit image 53 showing a state in which the hour hand H1 and the minute hand H2 move according to the current time. The image 52 continues to be displayed.

  Therefore, if there is a dynamic part that moves with the passage of time in a part of the captured image that is the original image, the dynamic part is a painting-like image that changes with the passage of time, and can be a still image or a movie. Can also enjoy and enjoy, and can generate and display interesting images. In addition, the time display portion image 53 displays the current time by sequentially replacing the hand images N1 including the hour hand H1 and the minute hand H2, thereby displaying the current time. An image can be displayed.

  More specifically, when a clock tower having an analog clock is photographed, the photographed photographed image can be automatically converted into a painting-like image, and the real time is engraved in the converted painting-like image. A real time display (clock) can be obtained.

  Moreover, the ratio of the length of the hour hand H1 and the minute hand H2 in the real time display unit (clock) that engraves the real time in the painting is the length ratio of the hour hand H1 and the minute hand H2 of the time display unit image in the photographed image. Corresponds with the ratio. Therefore, it is possible to display an analog real-time time in which a real time is engraved in a picture-like image without a sense of incongruity.

  Of course, the same applies to the case where the time display portion image is a digital display. When a dynamic portion that moves with the passage of time exists in a part of the captured image that is the original image, the dynamic portion is changed with the passage of time. A painting-like image that changes and can be viewed and enjoyed as a still image or a moving image, and an interesting image can be generated and displayed. At this time, since the time display unit image displays the current time by a numerical value, it is possible to generate and display a picture image that is practically sufficient.

  More specifically, when a tower or a building having a digital clock is photographed, the photographed photographed image can be automatically converted into a painting-like image, and the real time in the converted painting-like image is obtained. An engraved digital real time display (clock) can be obtained.

  In the present embodiment, in the flowchart of FIG. 4, the process of converting the photographed image into a painting-like image in step A14 is performed after step A13. However, after the process in step A19, the process of converting the photographed image into the painting-like image in step A14 may be performed. That is, in step A19, the time display portion image of the captured image may be sequentially replaced according to the current time, and after the replacement, the captured image may be converted into a landscape image and displayed.

  FIG. 12 is a flowchart showing details of the information acquisition / data transmission process (step A2) executed on the table clock 1 side.

  That is, the shooting position acquired by the GPS receiver 17 when the shooting process is executed in step A11 is stored in the clock tower location column 103 of the RAM 10 (step A31). Further, the distance from the photographing position to the clock tower acquired by the measurement by the distance measuring unit 16 when the photographing process is executed in step A11 is stored in the distance column 104 to the clock tower of the RAM 10.

Therefore, as shown in FIG. 3B, the photographing process in step A11, the GPS information acquisition process in step A31, and the H9 distance information acquisition process in step A32 are completed.
The clock tower image field 102 stores the clock tower image “AG2”.
In the clock tower location field 103, “Sapporo City AAA address (longitude / latitude)” indicating the shooting position is stored.
The distance to the clock tower 104 stores the distance “10 m” from the shooting position to the clock tower.

And in step A33 following step A32,
(1) Position information “Sapporo City AAA address (longitude / latitude)” stored in the clock tower location field 103 in the RAM 10;
(2) Distance information “10 m” from the shooting position stored in the distance table 104 to the clock tower to the clock tower;
Is transmitted to the site (server 500).

  FIG. 13A is a flowchart showing details of the information acquisition / data reception process (step B1) executed on the server 500 side. That is, the server 500 transmits (1) GPS position information (“Sapporo City AAA address (longitude / latitude)”) and (2) distance information (“10 m”) transmitted from the table clock 1 in step A33 described above. Is stored in the RAM 503.

  FIG. 13B is a flowchart showing details of the data editing process (step B2) executed on the server 500 side.

  That is, the server 500 reads the clock position name corresponding to the received GPS position information and distance information (“10 m”), the sound data of the bell sound, and the like from the ROM 502 (step B21).

  Here, as described above, it is assumed that the server 500 receives “Sapporo City AAA address (longitude / latitude)” as GPS position information and “10 m” as distance information. Then, in the ROM 502 of FIG. 3A, the clock tower corresponding to the GPS position information and the distance information is “name of clock tower having a radius within 1 km from the address of Sapporo AAA (longitude 123-latitude 456)”. "A (Sapporo clock tower)". Also, “AF” is stored as a bell sound (waveform) of “A (Sapporo clock tower)”. Accordingly, the server 500 reads the corresponding clock tower name “A (Sapporo clock tower)” and bell sound (waveform) “AF”.

  FIG. 13C is a flowchart showing details of the data transmission process (step B3) executed on the server 500 side. That is, the server 500 transmits the name of the clock tower, the sound of the bell, etc. read in step B21 to the user's table clock 1 (step B31). Therefore, in the case of the above-described example, the clock tower name “A (Sapporo clock tower)”, the bell sound (waveform) “AF”, and the like are transmitted to the user clock 1.

  FIG. 14A is a flowchart showing details of the data reception process (step A3) executed on the table clock 1 side.

  That is, the name of the clock tower, the sound of the bell, etc. transmitted from the server 500 side in the step B31 are received (step A41). Therefore, in the case of the above-described example, the clock tower name “A (Sapporo clock tower)”, bell sound (waveform) “AF”, etc. transmitted from the server 500 side are received by the user clock 1. Become.

  FIG. 14B is a flowchart showing details of the bell sound generation process (step A4) executed on the table clock 1 side.

  That is, the current time measured by the clock unit 13 is acquired and stored in the RAM 10 (step A51). As a result, for example, “AM10: 00” is written as the current time as shown in the bottom column of FIG.

  Next, the name of the clock tower stored in the RAM 10 is displayed below the liquid crystal display unit 2 (step A52). As a result, as shown in FIG. 1A, a picture-like image 52 in which, for example, the internal time display unit image N1 is replaced with the time display unit image 53 is displayed on the upper portion of the liquid crystal display unit 2. For example, “name: clock tower in Sapporo”, “distance to clock tower: 10 m”, and “shooting date 2011.09.01” are displayed at the bottom of the liquid crystal display unit 2.

  Therefore, the viewer can appreciate the picture-like image 52 while referring to the information by these displays.

  Next, it is determined whether or not the current time acquired from the clock unit 13 has reached a predetermined time (step A53). Here, the predetermined time is a noon time such as 1 o'clock, 2 o'clock, 3 o'clock, or the like. When the current time becomes a predetermined time (for example, the normal time), a bell sound is generated (step A54).

  In the bell sound generation processing in step A54, the bell sound waveform data read into the RAM 10 is read, and the sound based on the waveform data is reproduced by the sound emitting unit 18, amplified and amplified. The number is generated from 15 according to the time. Therefore, according to the present embodiment, it is possible to provide an image display apparatus and an image display method that can be enjoyed not only visually but also auditorily, and also have practicality. .

  More specifically, when a clock tower that generates the sound of a bell is photographed, the photographed image of the clock tower can be automatically converted into a picture-like image and displayed. The time can be notified by the sound of a bell generated by the.

  In the bell sound generation process in step A54, a bell sound is generated from the speaker 15 at a volume inversely proportional to the distance stored in the distance column 104 to the clock tower. Therefore, when the clock tower is photographed near the clock tower, a bell sound is generated at a high volume, and when the clock tower is photographed far away from the clock tower, a bell sound is generated at a small volume. To do. As a result, the user can obtain a sense of realism that he / she is at the place of shooting.

(Second Embodiment)
FIG. 15 is a flowchart showing a processing procedure of the table clock 1 and the server 500 in the second embodiment of the present invention.

  While the first embodiment described above is configured to display a photographed clock tower image converted into a painting-like image, this second embodiment displays the photographed clock tower image as a painting. The image is displayed without being converted into a wind image.

  The table clock 1 executes the process shown in the flowchart of FIG. 15A when the CPU 7 executes the process according to the program stored in the RAM 10. In the flowchart of FIG. 15A, steps A102 to A104 other than step A101 are the same as steps A2 to A4 in the first embodiment shown in FIG. Further, as shown in the flowchart of FIG. 15B, the server 500 executes the processes of steps B101 to B103, which are the same as steps B1 to B3 in the first embodiment shown in FIG. .

  That is, in the flowchart of FIG. 15, only step A101 is different from step A1 in the first embodiment, and only the photographing / display processing is performed without performing the painting conversion processing.

  FIG. 16 is a flowchart showing details of the photographing / display processing (step A101) executed in the second embodiment.

  That is, when the user carries the table clock 1 and, for example, directs the lens unit 3 toward the clock base 50 shown in FIG. 7 and presses the shutter key 4, the CPU 7 executes a photographing process (step A 111). Through this photographing process, the imaging unit 9 takes in the subject image formed by the lens unit 3 to obtain a photographed image, and stores this photographed image in the RAM 10 (step A112).

  As a result, as shown in FIG. 3B, for example, the clock tower image AG <b> 2 is stored in the clock tower image column 102 of the RAM 10.

  Subsequently, the CPU 7 drives the liquid crystal display unit 2 to display the captured image on the liquid crystal display unit 2 (step A113). As a result of the processing in step A13, a photographed image 51 having the clock tower 50 as the main subject is displayed on the liquid crystal display unit 2 as shown in FIG.

  Next, a time display part image recognition process is executed (step A114). Note that the details of the time display portion image recognition processing in step A114 are the same as those in the first embodiment shown in FIG.

  In step A115 following step A114 in the flowchart of FIG. 16, position coordinates indicating the position of the recognized time display portion image in the captured image are detected and stored in the RAM 10. At this time, the position coordinates of the time display part image are detected and stored in the position coordinates of the four points on the top, bottom, left and right of the circle image when the time display part image has a circle image (step A21; YES). If the time display portion image has a frame image (step A25; YES), the position coordinates of the four corners of the frame image are detected and stored.

  Note that only the position coordinates of the center portion of the circle image or only the position coordinates of the center portion of the frame image may be detected and stored.

  Next, based on the position coordinates stored in the RAM 10 in step A16, the time display portion image of the captured image is replaced with the built-in time display portion image specified in step A24 or step A27 (step A116).

  Further, the picture-like image is pasted and displayed on the clock display unit, which is the upper region of the liquid crystal display unit 2, while the internal time display unit image (N1) is sequentially replaced according to the current time measured by the clock unit 13 (step A117). , A118). As a result, the liquid crystal display unit 2 continues to display the photographic style image including the time display unit image 53 indicating the state in which the hour hand H1 and the minute hand H2 move according to the current time.

  As described above, also in the second embodiment, steps A102 to A104 are executed on the table clock 1 side similar to the first embodiment, and steps B101 to B103 are executed on the server 500 side. . Therefore, when the bell sound generation process is executed in step A104, the bell sound waveform data read into the RAM 10 is read out, and the sound based on the waveform data is reproduced by the sound emitting unit 18 and amplified. The number is generated from the speaker 15 according to the time. Therefore, according to the present embodiment, it is possible to provide an image display device and an image display method that can be enjoyed not only visually but also auditorily, and also have practicality. .

  More specifically, when a clock tower that generates a bell sound is photographed, a photographed image of the photographed clock tower can be displayed, and the time is notified by a bell sound generated by the photographed clock tower. can do.

(Third embodiment)
FIG. 17 is a flowchart showing a processing procedure of the table clock 1 and the server 500 in the third embodiment of the present invention.

  The first embodiment described above converts the clock tower image taken on the table clock 1 side into a painting-like image, whereas the third embodiment displays the clock tower image on the server 500 side. This is converted into a wind image and transmitted to the table clock 1.

  The table clock 1 executes the process shown in the flowchart of FIG. 17A by the CPU 7 executing the process according to the program stored in the RAM 10. In the flowchart of FIG. 17A, steps A204 to A206 other than steps A201 to A203 are the same as steps A2 to A4 in the first embodiment shown in FIG. Further, the server 500 executes the processing shown in the flowchart of FIG. In the flowchart of FIG. 17B, steps B203 to A205 other than steps B201 and B202 are the same as steps B1 to B3 in the first embodiment shown in FIG.

  That is, in the present embodiment, on the table clock 1 side, after performing the photographing / display processing (step A201), the photographed image transmission processing (step A202), and the painting-style image reception / display processing, the first embodiment described above. The information acquisition / data transmission process (step A204), the data reception process (step A205), and the bell sound generation process (step A206) similar to the above are sequentially executed.

  FIG. 18 is a flowchart showing details of the photographing / display processing (step A201) executed in the third embodiment.

  That is, when the user carries the table clock 1 and, for example, directs the lens unit 3 toward the clock base 50 shown in FIG. 7A and presses the shutter key 4, the CPU 7 executes a photographing process (step A211). Through this photographing process, the imaging unit 9 takes in the subject image formed by the lens unit 3 to obtain a photographed image, and stores this photographed image in the RAM 10 (step A212).

  As a result, as shown in FIG. 3B, for example, the clock tower image AG <b> 2 is stored in the clock tower image column 102 of the RAM 10.

  Subsequently, the CPU 7 drives the liquid crystal display unit 2 to display the captured image on the liquid crystal display unit 2 (step A213). As a result of the processing in step A13, a photographed image 51 having the clock tower 50 as the main subject is displayed on the liquid crystal display unit 2 as shown in FIG.

  Next, the table clock 1 transmits the captured image 51 to the server 500 by the captured image transmission process of step A202. Then, the server 500 performs a captured image reception process (step B201), and receives the captured image 51 transmitted from the table clock 1.

  Thereafter, the server 500 executes a painting-like conversion / transmission process (step B202). As in the first embodiment, any conventionally known conversion processing method may be used for the conversion processing of a captured image into a painting-like image in step 8202.

  For example, by adopting a technique disclosed in Japanese Patent Application Laid-Open No. 2004-213598, a color and a touch of a painter image that is an image of a specific painter stored in advance in the ROM 8 are extracted, and the photographed image is extracted. 51 and converted into a picture-like image. Conversion to a painting-like image involves analyzing the direction and strength of the texture from the procedure that simulates the photographed image 51 in the color of the painter image, the procedure of extracting the stroke characteristics from the painter image, and the image that simulates the color. And a procedure for arranging the extracted brush strokes based on the analysis result.

  In the procedure for simulating colors, a representative set of colors is created from the painter image, and a representative set of colors is also created from the photographed image 51. The color set creation is to plot color information on a color space and select and use a color frequently used from all colors used in an image. By comparing the color set of the photographed image 51 with the color set of the painter image, and performing re-coloring by mimicking, the photographed image 51 is converted into a painting-like image simulating the color.

  Alternatively, the photographed image 51 may be converted into an oil-like image by using the technique disclosed in Japanese Patent Laid-Open No. 60-198687 or the technique disclosed in Japanese Patent Laid-Open No. 61-150077. The photographed image 51 may be converted into an ink-like image using the technique disclosed in Japanese Patent Laid-Open No. 61-221878.

  By the conversion processing in step A14, a painting-like image 52 is generated and transmitted to the table clock 1 as shown in FIG. Then, the table clock 1 executes a painting-style image reception / display process (step A203).

  FIG. 19 is a flowchart showing details of the painting-style image reception / display processing (step A203). The table clock 1 receives the picture-like image 52 transmitted from the server 500 and displays it on the liquid crystal display panel 31 (step A221).

  Next, a time display portion image recognition process is executed (step A222). The details of the time display unit image recognition process in step A222 are the same as those in the first embodiment shown in FIG.

  Then, in step A223 following step A222 in the flowchart of FIG. 19, position coordinates indicating the position of the recognized time display portion image in the captured image are detected and stored in the RAM 10. At this time, the position coordinates of the time display part image are detected and stored in the position coordinates of the four points on the top, bottom, left and right of the circle image when the time display part image has a circle image (step A21; YES). If the time display portion image has a frame image (step A25; YES), the position coordinates of the four corners of the frame image are detected and stored.

  Note that only the position coordinates of the center portion of the circle image or only the position coordinates of the center portion of the frame image may be detected and stored.

  Next, based on the position coordinates stored in the RAM 10 in step A16, the time display part image of the painting-like image is replaced with the built-in time display part image specified in step A24 or step A27 (step A224). Therefore, by the processing in step A224, for example, the internal time display portion image N1 is replaced with the time display portion image 53 of the painting-like image 52 as shown in FIGS.

  Further, the picture-like image is pasted and displayed on the clock display unit, which is the upper area of the liquid crystal display unit 2, while sequentially replacing the internal time display unit image (N1) according to the current time measured by the clock unit 13 (step A225). 226). Thereby, as shown in FIG. 11C and FIG. 1A, the liquid crystal display unit 2 includes a painting style image including a time display unit image 53 showing a state in which the hour hand H1 and the minute hand H2 move according to the current time. The image 52 continues to be displayed.

  In the third embodiment, steps A204 to A206 are executed on the table clock 1 side as in the first embodiment as described above, and steps B203 to B206 are executed on the server 500 side. The Therefore, when the bell sound generation process is executed in step A206, the bell sound waveform data read into the RAM 10 is read, and the sound output unit 18 reproduces the sound based on the waveform data and amplifies it. The number is generated from the speaker 15 according to the time. Therefore, according to the present embodiment, it is possible to provide an image display apparatus and an image display method that can be enjoyed not only visually but also auditorily, and also have practicality. .

  More specifically, for example, when a building that generates a bell sound such as a clock tower is photographed, a photographed image of the photographed building can be automatically converted into a picture-like image and displayed. The time can be notified by the sound of a bell generated by the photographed building.

  Or, if you take a picture of a building that generates the sound of a bell, such as a clock tower, you can display a photographed image of the photographed building and notify the time with the sound of the bell that the photographed building generates. can do.

  In addition, since the conversion to the picture-like image is performed on the server 500 side without being performed on the table clock 1 side, the processing load on the table clock 1 can be reduced.

  In the present embodiment, the case where the present invention is applied to a table clock is shown, but the present invention is not limited to a table clock, and may be applied to other devices such as a mobile phone and a digital camera.

  In this embodiment, the table clock as a device has an imaging unit. However, the device itself does not have an imaging unit and acquires and stores an image captured by another device. May be. Further, in the embodiment, the clock tower has been described as an example of a building that generates the sound of a bell. Of course, it can be targeted.

DESCRIPTION OF SYMBOLS 1 Table clock 2 Liquid crystal display part 4 Shutter key 5 Function key 6 Slide switch 7 CPU
8 ROM
9 Imaging unit 10 RAM
11 Input unit 12 Divided image RAM
DESCRIPTION OF SYMBOLS 13 Clock part 14 Image composition part 15 Speaker 16 Distance measurement part 17 GPS receiving part 18 Sound emission part 19 Transmission / reception part 31 Liquid crystal display panel 50 Clock tower 51 Captured image 52 Painting-like image 500 Server 501 CPU
502 ROM
503 RAM
504 Input unit 505 Reception unit 506 Transmission unit 507 Data editing unit 508 Liquid crystal display unit

Claims (11)

An image display device including a storage unit, a clock unit, a display unit, and a sound emitting unit,
Photographing means;
Image conversion means for converting a photographed image of a building photographed by the photographing means into a painting-like image;
Position information acquisition means for acquiring position information indicating the shooting position of the photographed image by the photographing means;
Transmitting means for transmitting the position information acquired by the position information acquiring means to the server device;
Receiving means for receiving the sound data of the bell sound generated by the building transmitted from the server device after the transmitting means transmits the position information;
Storage control means for storing the sound data received by the receiving means in the storage unit;
Under the state where the picture-like image converted by the image conversion means is displayed on the display unit, when the current time counted by the clock unit becomes a predetermined time, the storage unit Control means for reading out the sound data and controlling the generation of a bell sound by the sound emitting unit based on the read sound data;
An image display device comprising: Further comprising distance measuring means for measuring a distance from the shooting position to the position of the building;
The storage means further stores the distance measured by the distance measurement means,
The image display apparatus according to claim 1, wherein the control unit controls generation of a bell sound by the sound emitting unit at a volume corresponding to the distance stored in the storage unit.   The image display device according to claim 1, wherein the photographed image is an image of a building that generates a bell sound such as a clock tower or a temple. An image display device comprising a storage unit, a clock unit and a display unit, and a sound emitting unit,
Photographing means;
Position information acquisition means for acquiring position information indicating the shooting position of the captured image of the building imaged by the imaging means;
Transmitting means for transmitting the position information acquired by the position information acquiring means to the server device;
Receiving means for receiving the sound data of the bell sound generated by the building transmitted from the server device after the transmitting means transmits the position information;
Storage control means for storing the sound data received by the receiving means in the storage unit;
The sound data is stored from the storage unit when the current time measured by the clock unit becomes a predetermined time under the state where the image captured by the imaging unit is displayed on the display unit. Control means for controlling the generation of a bell sound by the sound emitting unit based on the read sound data;
An image display device comprising: A server device connected via a network to an external device including a clock unit, a display unit, a sound emitting unit, and photographing means,
Receiving means for receiving position information indicating the photographing position of the photographing means transmitted from the external device;
Storage means for storing a plurality of sets of location information and sound data of a bell sound generated by a building in association with each other;
Transmitting means for reading the sound data of the bell sound corresponding to the position information received by the receiving means from the storage means, and transmitting the read sound data of the bell sound to the external device;
A server apparatus comprising: The storage means further stores the name of the building in association with the position information,
The transmission means reads the bell sound data and the building name corresponding to the position information received by the receiving means from the storage means, and the read bell sound data of the building 6. The server device according to claim 5, wherein a name is transmitted to the external device. A server device connected via a network to an external device including a clock unit, a display unit, a sound emitting unit, and photographing means,
Receiving means for receiving a photographed image of a building photographed by the photographing means transmitted from the external device and position information indicating the photographing position;
Image conversion means for converting a captured image of the building received by the receiving means into a painting-like image;
Storage means for storing a plurality of sets of location information and sound data of a bell sound generated by a building in association with each other;
The sound data of the bell sound corresponding to the position information received by the receiving means is read from the storage means, the read sound data of the bell sound, and the picture-like image converted by the image converting means; Transmitting means for transmitting to the external device;
A server apparatus comprising: An image display method in an apparatus including a storage unit, a clock unit, a display unit, and a sound emitting unit,
Shooting steps,
An image conversion step for converting a photographed image of the building photographed in this photographing step into a painting-like image;
A position information acquisition step of acquiring position information indicating a shooting position of the shot image by the shooting step;
A transmission step of transmitting the position information acquired by the position information acquisition step to the server device;
A reception step of receiving sound data of a bell sound generated by the building transmitted from the server device after transmitting the position information in this transmission step;
A storage control step of storing the sound data received in the reception step in the storage unit;
Under the state where the picture-like image converted by the image conversion step is displayed on the display unit, when the current time measured by the clock unit becomes a predetermined time, the storage unit A control step of reading out the sound data and controlling the generation of a bell sound by the sound emitting unit based on the read-out sound data;
An image display method comprising: An image display method in a device including a storage unit, a clock unit and a display unit, and a sound emitting unit,
Shooting steps,
A position information acquisition step for acquiring position information indicating a shooting position of a captured image of the building imaged by the imaging step;
A transmission step of transmitting the position information acquired by the position information acquisition step to the server device;
A reception step of receiving sound data of a bell sound generated by the building transmitted from the server device after transmitting the position information in this transmission step;
A storage control step of storing the sound data received in the reception step in the storage unit;
The sound data is stored from the storage unit when the current time measured by the clock unit becomes a predetermined time under the state where the image captured in the photographing step is displayed on the display unit. Control step of controlling the generation of the bell sound by the sound emitting unit based on the read sound data;
An image display method comprising: A control method of a server device connected via a network to an external device having a clock unit, a display unit, a sound emitting unit, and a photographing means,
A receiving step of receiving position information indicating a shooting position of the shooting step transmitted from the external device;
Read the sound data of the bell sound corresponding to the position information received by the receiving step from the storage means storing a plurality of sets of the positional information and the sound data of the bell sound generated by the building, A transmission step of transmitting the read sound data of the bell sound to the external device;
A control method for a server device. A method for controlling a server device connected via a network to an external device having a clock unit, a display unit, a sound emitting unit, and a photographing step,
A receiving step for receiving a photographed image of the building photographed in the photographing step transmitted from the external device and position information indicating the photographing position;
An image conversion step of converting the captured image of the building received by the reception step into a painting-like image;
Read the sound data of the bell sound corresponding to the position information received by the receiving step from the storage means storing a plurality of sets of the positional information and the sound data of the bell sound generated by the building, Transmitting the sound data of the read sound of the bell and the painting-like image converted by the image converting step to the external device;
A control method for a server device.