JP2004096226A - Image processing apparatus, method, computer program, and computer-readable storage medium - Google Patents

Abstract

[PROBLEMS] To easily edit the contents of a moving image file in a state where the edited moving image file and the thumbnail file are matched by newly creating a thumbnail file separately from the moving image file after editing the moving image file. To be able to confirm.
When a moving image file is edited, first, a file name to be edited and a first frame and a last frame of the edited moving image file are designated, and in the case of new saving, a saving file name is newly set. When overwriting, set the same file name as the edit target. Then, a moving image file is created based on the first frame information and the last frame information after editing, and then a thumbnail file reflecting information of the created moving image file is created.
[Selection diagram] FIG.

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image processing device, a method, a computer program, and a computer-readable storage medium used for an imaging device that captures, records, and reproduces a moving image.
[0002]
[Prior art]
Conventionally, an image processing device such as an electronic camera for recording and reproducing a still image or a moving image using a memory card having a solid-state memory element as a recording medium is already on the market, and an electronic camera equipped with an electronic finder such as a color liquid crystal panel is also sold. Have been. According to these electronic cameras, it is possible for the user of the electronic camera to determine the composition by continuously displaying images before photographing and to reproduce and confirm the photographed images. In particular, the function of reproducing a photographed image immediately after photographing is highly convenient and is a useful function for the user of the electronic camera.
[0003]
On the other hand, in digital cameras, more and more products have a function of capturing not only still images but also moving images, and the recording time and image size of moving images have also been improved. Some of such digital cameras create a thumbnail file by extracting one frame from a moving image as a file separate from the moving image when the moving image is captured. By creating a thumbnail file, the contents of a moving image file can be easily confirmed.
[0004]
In addition, some digital cameras have a moving image editing function, and it is possible to cut or combine moving images.
[0005]
[Problems to be solved by the invention]
2. Description of the Related Art In a digital camera that creates a thumbnail file when capturing a moving image, an image is displayed in advance from the thumbnail file when confirming the captured moving image. By creating the thumbnail file in the JPEG format, a part of the content of the moving image can be confirmed by the same processing as the still image. In addition, by writing information such as the number of frames of a moving image in the thumbnail file, information on the moving image can be obtained without analyzing the moving image.
[0006]
However, in a digital camera having an editing function, when a part of moving image data is deleted by editing, a situation may occur in which the edited moving image file and the thumbnail file do not match. For example, there is a possibility that one frame in the moving image indicated by the thumbnail file is not included in the edited moving image, and the information of the recording time of the moving image is also shifted.
[0007]
SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and after editing a moving image file, by creating a new thumbnail file separately from the moving image file, the edited moving image file and the thumbnail file are matched. It is an object of the present invention to be able to easily confirm the contents of the moving image file in the state.
[0008]
[Means for Solving the Problems]
An image processing apparatus according to the present invention includes an editing unit that edits a moving image file recorded on a recording medium, and a thumbnail file generating unit that generates a thumbnail file as a file separate from the edited moving image file. It has features.
[0009]
Another feature of the image processing apparatus of the present invention is that the image processing apparatus is used in an image pickup apparatus capable of recording a captured moving image on a recording medium and reproducing and displaying the moving image.
[0010]
Another feature of the image processing apparatus of the present invention resides in that the thumbnail file generating means extracts a frame included in the edited moving image file and generates a thumbnail file.
[0011]
Another feature of the image processing apparatus of the present invention resides in that the thumbnail file generating means extracts a frame designated by a user from the edited moving image file and generates a thumbnail file.
[0012]
According to another feature of the image processing apparatus of the present invention, the thumbnail file generating unit refers to a thumbnail file before editing corresponding to the moving image file and generates a thumbnail file of the edited moving image file. The point is to generate.
[0013]
Another feature of the image processing apparatus of the present invention is that, when a moving image file is updated by the editing means, an existing thumbnail file is updated in accordance with the updating of the moving image file. It is in.
[0014]
The image processing method of the present invention has an editing procedure for editing a moving image file recorded on a recording medium, and a thumbnail file generating procedure for generating a thumbnail file as a file separate from the edited moving image file. Has features.
[0015]
The computer program of the present invention causes a computer to execute an editing process for editing a moving image file recorded on a recording medium and a thumbnail file generating process for generating a thumbnail file as a file separate from the edited moving image file. It is characterized by points.
[0016]
The computer-readable storage medium of the present invention is characterized in that the computer program of the present invention is stored.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of an image processing apparatus, a method, a computer program, and a computer-readable storage medium of the present invention will be described with reference to the drawings.
[0018]
FIG. 1 is a diagram illustrating a configuration of an imaging device 100 such as a digital camera including the image processing device of the present embodiment. In FIG. 1, reference numeral 10 denotes a photographing lens, 12 denotes a shutter having an aperture function, 14 denotes an image sensor that converts an optical image into an electric signal, and 16 denotes an A / D converter that converts an analog signal output of the image sensor 14 into a digital signal. It is.
[0019]
Reference numeral 18 denotes a timing generation circuit that supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.
[0020]
Reference numeral 20 denotes an image processing circuit which performs predetermined pixel interpolation processing and color conversion processing on data from the A / D converter 16 or data from the memory control circuit 22. Further, in the image processing circuit 20, predetermined arithmetic processing is performed using the captured image data, and the system control circuit 50 controls the exposure control unit 40 and the distance measurement control unit 42 based on the obtained arithmetic result. TTL (through-the-lens) type AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-flash) processing. Further, the image processing circuit 20 performs predetermined arithmetic processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained arithmetic result.
[0021]
A memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32. The data of the A / D converter 16 is written to the image display memory 24 or the memory 30 via the image processing circuit 20 and the memory control circuit 22, or the data of the A / D converter 16 is directly written via the memory control circuit 22. It is.
[0022]
Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display unit composed of a TFT LCD or the like. Image data for display written in the image display memory 24 is transmitted through the D / A converter 26. The image is displayed by the image display unit 28. If image data captured using the image display unit 28 is sequentially displayed, an electronic finder function can be realized. Further, the image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50, and when the display is turned off, the power consumption can be significantly reduced.
[0023]
Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a sufficient storage capacity for storing a predetermined number of still images and moving images for a predetermined time. Accordingly, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area of the system control circuit 50.
[0024]
A compression / decompression circuit 32 compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like. The compression / decompression circuit 32 reads an image stored in the memory 30 and performs compression or decompression processing. Write to.
[0025]
An exposure control unit 40 controls the shutter 12 having an aperture function, and also has a flash dimming function in cooperation with the flash 48. Reference numeral 42 denotes a distance measurement control unit that controls focusing of the photographic lens 10, 44 denotes a zoom control unit that controls zooming of the photographic lens 10, and 46 denotes a barrier control unit that controls the operation of the protection unit 102, which is a barrier.
[0026]
Reference numeral 48 denotes a flash, which also has a function of projecting AF auxiliary light and a function of flash light control. The exposure control unit 40 and the distance measurement control unit 42 are controlled using the TTL method. The system control circuit 50 controls the exposure control unit 40 and the distance measurement based on the calculation result obtained by calculating the captured image data by the image processing circuit 20. The control unit 42 is controlled.
[0027]
50 is a system control circuit for controlling the whole. In the present embodiment, the system control circuit 50 is a main component and functions as an editing unit and a thumbnail file generating unit according to the present invention. Reference numeral 52 denotes a memory for storing constants, variables, programs, and the like for operation of the system control circuit 50.
[0028]
Reference numeral 54 denotes a notification unit such as a liquid crystal display device or a speaker that displays an operation state or a message using characters, images, sounds, or the like in accordance with the execution of the program in the system control circuit 50. One or a plurality of them are installed at easy positions, and are constituted by a combination of, for example, an LCD, an LED, and a sound generating element. The notification unit 54 has a part of its functions installed in the optical finder 104.
[0029]
Among the display contents of the notifying section 54, those displayed on the LCD or the like include a single shot / continuous shooting display, a self-timer display, a compression ratio display, a recording pixel number display, a recording number display, a remaining number of shots display, a shutter. Speed display, Aperture display, Exposure compensation display, Flash display, Red-eye reduction display, Macro shooting display, Buzzer setting display, Battery remaining battery display, Battery remaining display, Error display, Information display with multiple digits, Recording The display includes the attachment / detachment state display of the media 200 and 210, the communication I / F operation display, the date / time display, and the like.
[0030]
Further, among the display contents of the notification unit 54, those displayed in the optical viewfinder 104 include a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like.
[0031]
Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory, for example, an EEPROM or the like.
[0032]
Reference numerals 60, 62, 64, 66, 68, and 70 denote operation units for inputting various operation instructions of the system control circuit 50. The operation unit includes a switch, a dial, a touch panel, pointing by gaze detection, a voice recognition device, or the like. It is composed of multiple combinations.
[0033]
Here, these operation units will be specifically described. Reference numeral 60 denotes a mode dial switch, which can switch and set various function modes such as a power-off mode, an automatic shooting mode, a shooting mode, a panoramic shooting mode, a playback mode, a multi-screen playback / erase mode, and a PC connection mode.
[0034]
Reference numeral 62 denotes a shutter switch SW1, which is turned on during operation of a shutter button (not shown) to perform AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-flash) processing, and the like. Instruct operation start.
[0035]
Reference numeral 64 denotes a shutter switch SW2 which is turned on when the operation of a shutter button (not shown) is completed, and writes a signal read from the image sensor 12 into the memory 30 via the A / D converter 16 and the memory control circuit 22 in an exposure process. A development process using an operation in the image processing circuit 20 or the memory control circuit 22; a recording process in which image data is read from the memory 30, compressed by the compression / decompression circuit 32, and written into the recording medium 200 or 210. Instructs the start of a series of processing operations.
[0036]
An image display ON / OFF switch 66 can set ON / OFF of the image display unit 28. With this function, it is possible to save power by cutting off the current supply to an image display unit such as a TFT LCD when taking a picture using the optical finder 104.
[0037]
Reference numeral 68 denotes a quick review ON / OFF switch, which sets a quick review function for automatically playing back image data shot immediately after shooting. In this embodiment, a function for setting a quick review function when the image display unit 28 is turned off is provided.
[0038]
Reference numeral 70 denotes an operation unit including various buttons, a touch panel, and the like. A menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, a single / continuous / self-timer switching button, and a menu shift + (plus) Buttons, a menu move- (minus) button, a play image move + (plus) button, a play image- (minus) button, a photographing image quality selection button, an exposure correction button, a date / time setting button, and the like.
[0039]
Reference numeral 80 denotes a power control unit, which includes a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like. The DC-DC converter is controlled based on an instruction from the system control circuit 50, and a required voltage is supplied to each unit including a recording medium for a required period.
[0040]
Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a power supply including a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, and an AC adapter.
[0041]
Reference numerals 90 and 94 denote an interface with a recording medium such as a memory card or a hard disk, reference numerals 92 and 96 denote connectors for connecting to a recording medium such as a memory card or a hard disk, and reference numeral 98 denotes a connector 92 or 96 to which a recording medium 200 or 210 is mounted. This is a recording medium attachment / detachment detection unit for detecting whether or not the recording medium is attached. In the present embodiment, the interface and the connector for attaching the recording medium are described as having two systems. However, the interface and the connector may have a single or plural number of systems. Further, a configuration may be adopted in which interfaces and connectors of different standards are provided in combination. The interface and the connector may be configured by using a standard such as a PCMCIA card or a CF (Compact Flash (R)) card. Further, when the interfaces 90 and 94 and the connectors 92 and 96 are configured using a standard such as a PCMCIA card or a CF (Compact Flash (R)) card, a LAN card, a modem card, a USB card, an IEEE 1394 card By connecting various communication cards such as a P1284 card, a SCSI card, a communication card such as a PHS, and the like, image data and management information attached to the image data can be transferred to and from other peripheral devices such as a computer and a printer. Can fit.
[0042]
Reference numeral 102 denotes a protection unit which is a barrier that covers the imaging unit including the lens 10 to prevent the imaging unit from being stained or damaged.
[0043]
Reference numeral 104 denotes an optical finder, which enables photographing using only the optical finder without using the electronic finder function of the image display unit 28. In the optical viewfinder 104, some functions of the notification unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are provided.
[0044]
A communication unit 110 has various communication functions such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.
[0045]
Reference numeral 112 denotes a connector connected to another device by the communication unit 110 or an antenna in the case of wireless communication.
[0046]
Reference numeral 200 denotes a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 202 including a semiconductor memory or a magnetic disk, an interface 204 with the imaging device 100, and a connector 206 for connecting to the imaging device 100.
[0047]
210 is a recording medium such as a memory card or a hard disk. The recording medium 210 includes a recording unit 212 including a semiconductor memory or a magnetic disk, an interface 214 with the imaging device 100, and a connector 216 for connecting to the imaging device 100.
[0048]
FIG. 2 is a diagram for explaining operation members of the imaging device 100. A power button 301 is used to start and end the digital camera. A menu button 302 is a button used to enter a menu for changing a shooting mode, setting a date, protecting or deleting an image, and the like. It is also used to end various setting modes. A decision button 303 is used to decide a selection item.
[0049]
A display button 304 switches display / non-display of shooting information regarding an image. The left button 305 is used to move a selected item to the left or to feed an image. A right button 306 is used to move a selected item to the right or to feed an image. The up button 307 is used to move a selected item up. The down button 308 is used to move a selected item down.
[0050]
A shutter button 310 is a button used when shooting in a shooting mode. The mode switch 311 switches between a recording mode and a playback mode. The liquid crystal screen 312 is used when photographing while confirming the image, and also used for confirming the photographed image.
[0051]
FIG. 3 is a flowchart illustrating the flow of the processing operation of the image processing apparatus according to the present embodiment. When performing moving image editing, first, a file name (FILE1) to be edited and a first frame (Ns) and a last frame (Ne) of the edited moving image are designated (step S301).
[0052]
Next, it is determined whether or not the storage method selected by the user is new storage (step S302). If not, it is determined whether or not overwrite storage is performed (step S303). In the case of new saving, a saving file name is newly set as, for example, FILE2 (step S304). In the case of overwriting, the same file name (FILE1) as the edit target is set (step S305).
[0053]
Then, a moving image file of image data between the two frames is created based on the first frame and last frame information set in step S301 (step S306). In the case of overwriting, the existing moving image file is updated.
[0054]
Thereafter, a thumbnail file reflecting the information of the created moving image file is created (step S307). In the case of overwriting, the existing thumbnail file is updated corresponding to the update of the moving image file. In this thumbnail file creation, if the image of the existing thumbnail file is included in the image of the edited moving image file, the thumbnail file may be created based on the existing thumbnail file before editing. It is possible.
[0055]
FIG. 4 shows a display of the liquid crystal screen 401 (the liquid crystal screen 312 in FIG. 2) when editing a moving image. On the screen 401, a display image 402, a front part cut button 403, a rear part cut button 404, and a save button 405 are displayed on the left side as an edit menu, an indicator 406 indicating the contents of editing, and a counter indicating the total number of seconds after editing. 407 is displayed at the bottom of the screen.
[0056]
The item of the edit menu is moved by the up button 307 and the down button 308. When the front part cut button 403 or the rear part cut button 404 is to be selected, the editing position can be moved by the left button 305 and the right button 306. When the save button 405 is selected, an edit save button as shown in FIG. 5 appears.
[0057]
FIG. 5 shows an edit save screen. When the save button 405 is selected with the up and down buttons in the edit menu of FIG. 4, the edit save buttons 501 and 502 appear. A storage method is selected with the left button 305 and the right button 306, and determined with the determination button 303. At this time, the remaining capacity of the storage device is calculated, and if the remaining capacity is small, only overwriting can be selected.
[0058]
FIG. 6 shows a relationship between a moving image and a thumbnail file before and after editing. Reference numeral 601 denotes a virtual configuration of a moving image file before editing, and 603 denotes a virtual configuration of a thumbnail file for the moving image before editing. From this state, a moving image 603 that has not been cut at positions newly designated as the first frame and the last frame by the editing operation, and a thumbnail file 604 including the information are generated.
[0059]
Although the editing menu shown in FIG. 4 includes only a front partial cut and a rear partial cut, the same applies to editing contents such as combination and division, and the editing contents are not limited.
[0060]
Although the thumbnail file 604 generated after editing shown in FIG. 6 is described above, if the image information of the existing thumbnail file is included in the image information in the edited moving image file, the thumbnail file 604 before editing is displayed. 602 may be created, or information may be acquired from a moving image to create it. Further, the image to be extracted from the moving image as the thumbnail may be determined as the first frame of the edited moving image file, or may be determined by the user.
[0061]
(Other embodiments)
In order to operate various devices to realize the functions of the above-described embodiments, program codes of software for realizing the functions of the above-described embodiments are transmitted to an apparatus connected to the various devices or a computer in a system. The present invention also includes those which are supplied and operated by operating the above-described various devices according to a program stored in a computer (CPU or MPU) of the system or the apparatus.
[0062]
In this case, the software program code itself implements the functions of the above-described embodiment, and the program code itself constitutes the present invention. As a transmission medium of the program code, a communication medium (a wired line or a wireless line such as an optical fiber) in a computer network (WAN such as a LAN or the Internet, a wireless communication network, etc.) system for transmitting and supplying the program information as a carrier wave. Etc.) can be used.
[0063]
Further, means for supplying the program code to a computer, for example, a recording medium storing the program code constitutes the present invention. As a recording medium for storing such a program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, and the like can be used.
[0064]
When the computer executes the supplied program code, not only the functions of the above-described embodiments are realized, but also the OS (operating system) or other application software running on the computer. Needless to say, such a program code is also included in the embodiment of the present invention when the functions of the above-described embodiment are implemented in cooperation with the above.
[0065]
Further, after the supplied program code is stored in a memory provided in a function expansion board of a computer or a function expansion unit connected to the computer, a CPU provided in the function expansion board or the function expansion unit based on the instruction of the program code. It goes without saying that the present invention also includes a case where the functions of the above-described embodiments are implemented by performing part or all of the actual processing.
[0066]
It should be noted that the shapes and structures of the respective parts shown in the above embodiments are merely examples of the embodiment for carrying out the present invention, and the technical scope of the present invention is interpreted in a limited manner. It must not be done. That is, the present invention can be embodied in various forms without departing from the spirit or main features thereof. For example, the recording media 200 and 210 include not only memory cards such as PCMCIA cards and compact flash (R), hard disks, but also micro DATs, magneto-optical disks, optical disks such as CD-R and CD-WR, and DVDs. Of course, there is no problem even if it is constituted by a variable optical disk or the like. Also, there is no problem if the recording media 200 and 210 are composite media in which a memory card and a hard disk are integrated. Further, there is no problem even if a part of the composite medium is detachable. Further, the recording media 200 and 210 have been described as being separated from the imaging device 100 and can be arbitrarily connected. However, there is no problem even if any or all of the recording media remain fixed to the imaging device 100. .
[0067]
【The invention's effect】
As described above, according to the present invention, after editing a moving image, a new thumbnail file is created separately from the moving image file, so that the edited moving image file and the thumbnail file match, It is possible to easily confirm the contents of the moving image file.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of an imaging device 100 such as a digital camera including an image processing device according to an embodiment.
FIG. 2 is a diagram for explaining operation members of the imaging apparatus 100.
FIG. 3 is a flowchart illustrating a flow of a processing operation of the image processing apparatus.
FIG. 4 is a diagram showing an example of a screen display when editing a moving image.
FIG. 5 is a diagram showing an example of an edit save screen.
FIG. 6 is a diagram for explaining a relationship between a moving image and a thumbnail file before and after editing.
[Explanation of symbols]
14 Image sensor 24 Image display memory 28 Image display unit 30 Memory 50 System control circuit 54 Display unit 200 Recording medium 201 Recording medium

Claims (9)

Editing means for editing a moving image file recorded on a recording medium;
An image processing apparatus comprising: a thumbnail file generating unit that generates a thumbnail file as a file different from the edited moving image file. The image processing apparatus according to claim 1, wherein the captured moving image is recorded on a recording medium, and is used in an imaging apparatus capable of reproducing and displaying. 2. The image processing apparatus according to claim 1, wherein the thumbnail file generating unit extracts a frame included in the edited moving image file and generates a thumbnail file. 2. The image processing apparatus according to claim 1, wherein the thumbnail file generation unit extracts a frame specified by a user from the edited moving image file and generates a thumbnail file. 2. The image processing apparatus according to claim 1, wherein the thumbnail file generating unit generates a thumbnail file of the edited moving image file by referring to a thumbnail file before editing corresponding to the moving image file. 2. The image processing apparatus according to claim 1, wherein when the moving image file is updated by the editing unit, an existing thumbnail file is updated in response to the updating of the moving image file. An editing procedure for editing a moving image file recorded on a recording medium,
A thumbnail file generation procedure for generating a thumbnail file as a file separate from the edited moving image file. Editing processing for editing a moving image file recorded on a recording medium;
A computer program for causing a computer to execute a thumbnail file generation process of generating a thumbnail file as a file separate from the edited moving image file. A computer-readable storage medium storing the computer program according to claim 8.

Images