JP2010062834A - Photographing system, photographing device constituting the same, and operation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain zooming and focusing states desired by a user without receiving the influence of data communication delay in a network when photographing a still image by an operation from a remote place. <P>SOLUTION: When the operation of zooming and focusing, for example, with respect to a camera 101 is stopped in a PC 102, an operation stop command G is issued to the camera 101, and also data, which indicate the state of a photographing optical system 1011 having a zoom lens and a focus lens in the camera 101, i.e., the image data of a live view image, which are displayed in the finder 701 of a window 700 when the operation is stopped, is transmitted to the camera 101 as adjustment data J which indicate the state of the optical system in the camera 101. In the camera 101, the zoom lens and the focus lens in the photographing optical system 1011 are adjusted in order to maximize correlation between the adjustment data J from the PC 102 and the image data to be photographed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging system that enables data communication between an imaging device that captures a subject image and an operation device that operates the imaging device via a network, and an imaging device and an operation device that constitute the imaging system.

In recent years, digital cameras, which are photographing apparatuses, that are compatible with a wide variety of communication interfaces have started to appear. In particular, digital cameras that can be directly connected to a network by radio have also appeared.
Such a digital camera is configured such that the digital camera is provided at a remote location from an operator, for example, and the digital camera provided at the remote location is operated via a network, or an image obtained by this shooting is acquired. It has various merits such as downloading data.

However, when photographing a remote digital camera via a network, data communication between the digital camera and the operation side takes time because data communication on the network between the digital camera and the operation side takes time. Is delayed. Under the influence of the delay of data communication on the network, when shooting with a remote digital camera, the shooting operability may be significantly reduced.
For example, when trying to determine zooming by adjusting the zoom magnification of the optical system in the photographic device via the network from the operating device, the image captured on the photographic device side and the image confirmed on the operating device side There is a time difference between them. For this reason, even if the operator confirms that the operator has reached the desired position on the operating device side and performs an operation to stop, for example, the imaging device side has already passed the desired position, and at an unintended position of the operator. It will result in stopping. For this reason, the operator needs to perform repeated operations in order to achieve a desired zooming or focus state, and the operability is extremely deteriorated.

As a technique for solving such a problem, there is, for example, Patent Document 1. This patent document 1 relates to a video transmission system, wherein a first server adds time reference information to a video signal and outputs it, and a terminal adds control time information created from the time reference information to a control command and outputs it. The first server discloses correcting the shift due to delay by returning the camera to the state of the video displayed on the monitor when a control command is issued based on the control time information.
Japanese Patent Laid-Open No. 9-284627

  However, the above-described video transmission system is a technique for quickly correcting overrun due to a control delay, and cannot capture zooming or a focus state desired by a user in capturing a still image.

  An object of the present invention is to provide a shooting system capable of obtaining a zooming and focus state desired by a user without being affected by a delay of data communication in a network when shooting a still image by operating from a remote place, and the shooting An object of the present invention is to provide an imaging device and an operation device that constitute a system.

  An imaging system according to a main aspect of the present invention includes an imaging device that captures a subject image and an operating device that operates the imaging device via a network. The operating device transmits image data transmitted from the imaging device. The image receiving means for sequentially receiving the image data, the image display means for sequentially displaying the image data received by the image receiving means, the operating means for giving an operation instruction to the optical system of the photographing apparatus, and the operation means. An optical system setting generating means for generating information for specifying settings for the optical system of the photographing apparatus as optical system setting information based on the image data displayed on the image display means at the point of time, and an optical system for the photographing apparatus An optical system setting transmission means for transmitting setting information, and the photographing apparatus operates a photographing means for continuously photographing a subject image and image data acquired by photographing by the photographing means. Image transmission means for sequentially transmitting to the device, optical system setting receiving means for receiving the optical system setting information transmitted from the operating device, and adjustment of the optical system based on the optical system setting information received by the optical system setting receiving means And an optical adjusting means for performing.

  An operation device according to a main aspect of the present invention operates a photographing device for photographing a subject image via a network, and includes an image receiving unit that sequentially receives image data transmitted from the photographing device, and an image receiving unit. Image display means for sequentially displaying received image data, operation means for giving an operation instruction to the optical system of the photographing apparatus, and an image displayed on the image display means when the operation means is operated An optical system setting generation unit configured to generate, as optical system setting information, information specifying settings for the optical system of the imaging apparatus based on the data; and an optical system setting transmission unit configured to transmit the optical system setting information to the imaging apparatus. To do.

  An imaging device according to a main aspect of the present invention receives an operation from an operation device via a network, and includes an imaging unit that continuously shoots a subject image and image data acquired by imaging of the imaging unit. The image transmission means for sequentially transmitting the optical system, the optical system setting receiving means for receiving the optical system setting information transmitted from the operating device, and the adjustment of the optical system based on the optical system setting information received by the optical system setting receiving means. Optical adjusting means for performing.

  According to the present invention, when a still image is shot by operating from a remote place, a shooting system capable of obtaining a zooming or focus state desired by a user without being affected by a delay in data communication in the network, and the shooting An imaging device and an operation device that constitute the system can be provided.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 shows an example of an imaging system in which a camera 101 having a wireless communication function is remotely operated by a personal computer (hereinafter referred to as a PC) 102 via a network. In this photographing system, a camera 101 as a photographing device for photographing a subject image and a PC 102 as an operation device are connected via a router 103 constituting a wireless local area network (hereinafter referred to as wireless LAN). . In this photographing system, the camera 101 and the PC 102 are connected via the router 103. However, the present invention is not particularly limited to this. For example, communication directly connected by ad hoc or BLUETOOTH (registered trademark) is also used. It may be a wired connection.

  The camera 101 includes a photographing optical system 1011 and an antenna 1012 on the upper surface. The photographing optical system 1011 of the camera 101 includes a zoom lens and a focus lens. The PC 102 includes a display 1021.

In such a photographing system, the camera 101 photographs a subject through the photographing optical system 1011. The image data of the photographed subject is sent to the PC 102 via the wireless LAN. The PC 102 displays the photographed subject image on the display 1021.
On the display 1021 of the PC 102, for example, a camera control software window 700 as shown in FIG. 2 is displayed. In this window 700, for example, a finder unit 701, a focus control switch 702, a zoom control switch 703, and a release button 704 are displayed. Among these, the finder unit 701 displays the live view image data F1 of the subject sent from the camera 101.

The focus control switch 702 receives a manual operation by the user and outputs a focus adjustment instruction signal of the camera 101, that is, a focusing adjustment instruction signal. The focus control switch 702 can adjust the focus within a range of distance “0 m” to infinity “∞”, for example. The manual operation on the focus control switch 702 is performed by, for example, a click operation with a mouse pointer by a user.
The zoom control switch 703 receives a manual operation by the user and outputs a signal for changing the focal length due to the zoom of the camera 101, that is, a signal for changing the zooming. The zoom control switch 703 can change the focal length in a range from the TEL end to the WIDE end, for example. The manual operation on the zoom control switch 703 is also performed by a click operation with a mouse pointer by a user, for example.
The release button 704 outputs a shooting start instruction signal in response to a manual operation by the user. The manual operation for the release button 704 is also performed by a click operation with a mouse pointer by the user, for example.

Next, with reference to FIGS. 3A to 3D, an outline of photographing by remote operation of the photographing system will be described in four phases.
First, an operation standby state is shown in FIG. The camera 101 transmits image data obtained by photographing a subject to the PC 102 as live view image data F1 via the wireless LAN router 103. The PC 102 receives the live view image data F1 from the camera 101, and displays the live view image in real time on the finder unit 701 of the window 700. The user confirms the state of the subject by viewing the live view image displayed on the finder unit 701 of the window 700. Note that the live view image data F1 from the camera 101 may be added with data indicating the state of the zoom lens and the focus lens of the photographing optical system 1011 in the camera 101.

Next, the operation start state is shown in FIG. On the PC 102 side, the user starts framing and focusing operations while checking the live view image displayed on the finder unit 701 of the window 700. For example, when the “△” portion on the TEL end side of the zoom control switch 703 for framing adjustment is pressed by a click operation with a mouse pointer by the user, the PC 102 sends a command (operation instruction) H for increasing the zoom magnification to the camera 101. To the other side.
For example, when the camera 101 receives a command (operation instruction) H for increasing the zoom magnification for framing adjustment from the PC 102 side, the camera 101 starts a zoom operation for moving the zoom lens in the photographing optical system 1011 to increase the zoom magnification. . At this time, similarly to the above, the camera 101 continues to transmit the image data obtained by photographing the subject to the PC 102 as the live view image data F1 via the wireless LAN router 103.

Next, the state of operation stop is shown in FIG. In this operation stop state, the user confirms the live view image displayed on the finder unit 701 of the window 700 while operating the zoom control switch 703, for example, on the PC 102 side, and the zoom control switch 703 displays the desired zoom. When the position corresponding to the magnification is reached, the operation is stopped. For example, when the pointer to the zoom control switch 703 that was pressed in the previous phase is released, the PC 102 sends a command (stop instruction) G that instructs the camera 101 to stop the operation for framing adjustment, for example. To emit.
At the same time, the PC 102, when the pointer to the zoom control switch 703 is released, shows data indicating the state of the optical system of the camera 101, for example, an optical system of the camera 101 corresponding to zooming adjustment, that is, a photographing optical system including a zoom lens. Data indicating the state of 1011 is transmitted to the camera 101. If an operation stop command (stop instruction) G for the focusing adjustment is issued to the camera 101, the PC 102 changes the state of the optical system of the camera 101 corresponding to the focusing adjustment, that is, the state of the photographing optical system 1011 including the focus lens. Data shown is transmitted to the camera 101.

Here, in the present embodiment, the PC 102 adjusts the image data of one frame of the live view image displayed on the finder unit 701 of the window 700 when the operation is stopped to indicate the state of the optical system of the camera 101. This is transmitted to the camera 101 as data J for use.
If the position information of the zoom lens and the focus lens is added to the live view image data F1, the adjustment data J may transmit the position information of the zoom lens and the focus lens instead of the image data. .

  Next, a lens position finalized state is shown in FIG. The camera 101 receives the adjustment data J from the PC 102 and, for example, the zoom lens of the imaging optical system 1011 so that the correlation between the adjustment data J and the image data acquired by the camera 101 is maximized. Adjust the position. In the case of focus adjustment, the camera 101 adjusts, for example, the position of the focus lens in the photographing optical system 1011.

  Note that when position information of the zoom lens and the focus lens is sent as the adjustment data J, the position of each lens is adjusted based on the information.

  The camera 101 also transmits image data obtained by photographing a subject as live view image data F1 to the PC 102 via the wireless LAN router 103 when adjusting the zoom lens and the focus lens in the photographing optical system 1011. The PC 102 receives the live view image data F1 from the camera 101, and displays the live view image in real time on the finder unit 701 of the window 700. The user confirms that the live view image has the desired framing and focus by viewing the live view image displayed on the viewfinder unit 701 of the window 700, and moves to shooting.

Next, the internal configuration of the camera 101 will be specifically described with reference to FIG.
The camera 101 is provided with a photographing optical system 1011. The photographing optical system 1011 forms a subject image of a subject, and includes a zoom lens and a focus lens. The CCD 202 is a photographing means for continuously photographing a subject image, and converts the subject image formed by the photographing optical system 1011 into an electric signal.

  An antenna 1012 is connected to the WLAN module 204. The WLAN module 204 is a communication module for data communication with the PC 102 via a wireless LAN. The WLAN module 204 has a function of an image transmission unit that sequentially transmits the live view image data F <b> 1 acquired by photographing with the camera 101 to the PC 102. The WLAN module 204 has a function of receiving, for example, a command (operation instruction) H for increasing the zoom magnification from the PC 102, for example, a command (stop instruction) G for instructing stop of the operation for zooming adjustment.

  Further, the WLAN module 204 functions as an optical system setting receiving unit that receives the optical system setting information transmitted from the PC 102, that is, adjustment data J as data indicating the state of the zoom lens and the focus lens of the photographing optical system 1011. Have In the present embodiment, the live view image F1 and the adjustment data J are the same.

  Further, the WLAN module 204 has a function as a setting information transmission unit that transmits the live view image data F1 associated with the setting information of the zoom lens and the focus lens of the photographing optical system 1011 to the PC 102.

The TFT panel 205 displays the image of the subject image, the image acquired by shooting, and the state and menu of the camera 101 when setting is performed by the user.
The memory card 206 records photographed image data acquired by photographing.
The system memory 207 temporarily stores image data acquired by photographing of the CCD 202. The system memory 207 temporarily stores main image data and live view image data F1 at the time of photographing, and photographing operation of the camera 101. The program etc. for making it perform is held.
The system controller 203 controls each unit in the camera 101.

A setting switch 208 is a switch for selecting various settings related to the operation of the camera 101 and camera operations.
The release button 209 instructs the start of each shooting of the camera 101 separately from the case of operating via the wireless LAN. The release button 209 has a function of instructing the camera 101 to start shooting.
The encoder 210 detects the position of the photographing optical system 1011, that is, the positions of the zoom lens and the focus lens of the photographing optical system 1011. This result is read by the system controller 203.
The actuator 211 moves each position of the zoom lens and the focus lens of the photographing optical system 1011 under the control of the system controller 203.

  FIG. 5 shows a detailed configuration diagram inside the system controller 203. The system controller 203 includes a system bus 300. The system bus 300 includes, for example, a CCD controller 301, a CPU 302, an image processing unit 303, an LCD controller 304, an SDRAM controller 305, a communication interface 306, and a correlation detection circuit 307 as functional blocks having various functions. And a memory card interface 308.

The CPU 302 controls each block in the system controller 203, that is, controls the image processing unit 303, the LCD controller 304, the SDRAM controller 305, the communication interface 306, the correlation detection circuit 307, and the memory card interface 308.
The CPU 302 in the camera 101 is based on the optical system setting information received by the WLAN module 204, that is, the adjustment data J as data indicating the state of the zoom lens and the focus lens of the photographing optical system 1011. And a function as an optical adjusting means for adjusting the focus lens.

The CPU 302 calculates the positions of the zoom lens and the focus lens of the photographing optical system 1011 where the correlation between the adjustment data J detected by the correlation detection circuit 307 and the image data acquired by photographing with the camera 101 is the highest. It has a function as an optical system set value calculation means.
However, the CPU 302 issues a command to adjust the positions of the zoom lens and the focus lens of the photographing optical system 1011 based on the adjustment positions of the zoom lens and the focus lens of the photographing optical system 1011 calculated by the optical system setting value calculation unit. .

  The CPU 302 is also associated with association means for associating the setting information of the zoom lens and the focus lens of the photographing optical system 1011 at the time of photographing the subject image with the image data of the live view image data F1 acquired at the photographing time, for example, frame data. The association unit has a function as a setting information transmission unit that transmits the setting information of the zoom lens and the focus lens of the photographing optical system 1011 associated with the image data from the WLAN module 204.

The SDRAM controller 305 writes / reads various data to / from the system memory 207 according to a request from each functional block.
The CCD controller 301 reads an electrical signal obtained by photoelectrically converting the subject image output from the CCD 202 as image data, and stores this image data in the system memory 207 via the SDRAM controller 305. At this time, the CCD controller 301 changes the reading method between the read operation of the live view image data F1 and the read operation of the photographed image data acquired by the main photographing. That is, in the case of reading the live view image data F1, the CCD controller 301 performs photographing in a mode in which the image data from the CCD 202 is subjected to processing such as thinning and pixel averaging to reduce the amount of image data. The CCD controller 301 reads out image data from all pixels of the CCD 202 in the case of reading out the main image data acquired by the main photographing.

  The image processing unit 303 performs various image processing such as filter processing and image compression processing on image data, and conversion to an image format (hereinafter referred to as TFT format) corresponding to image display on the TFT panel 205. The image processing unit 303 performs, for example, a low-pass filter, JPEG compression, and TFT format conversion. The processing result of the image processing unit 303 is recorded in the system memory 207 via the SDRAM controller 305.

  The LCD controller 304 performs control to display and output the image data converted into the TFT format by the image processing unit 303 to the TFT panel 205 in accordance with the synchronization signal. The LCD controller 304 performs gamma correction on the image data converted into the TFT format in accordance with the characteristics of the TFT panel 205.

The memory card interface 308 causes the memory card 206 to record the image data acquired by the actual photographing.
The communication interface 306 communicates with the WLAN module 204 and transmits / receives data to / from an external device connected to the wireless LAN having the router 103, in this case, the PC 102.

  The correlation detection circuit 307 is displayed on the viewfinder section 701 of the window 700 of the PC 102 when the image data that is the adjustment data J sent from the PC 102, that is, when the operation such as zoom lens adjustment or focus adjustment is stopped. Correlation detecting means for calculating a correlation value between the adjustment data J indicating the state of the optical system of the camera 101 and the image data captured from the CCD 202 and stored in the system memory 207 by photographing with the live view image As a function.

The pulse generator 309 generates pulses according to the control of the CPU 302. This generated pulse becomes a pulse signal for driving the actuator 211.
The counter 310 detects the position of the photographing optical system 1011 by counting pulse signals generated in accordance with the movement of the zoom lens and the focus lens of the photographing optical system 1011 from the encoder 210.

FIG. 6 shows a block diagram of components of the PC 102 which is an operating device.
The PC 102 is equipped with a CPU 401. A LAN interface 402, a system memory 403, a display device 404, and an operation mechanism 405 are connected to the CPU 401. The CPU 401 controls the LAN interface 402, the system memory 403, the display device 404, and the operation mechanism 405 in an integrated manner.

  Of these, the LAN interface 402 is connected to a wireless LAN to exchange data. In this embodiment, the LAN interface 402 exchanges image data and various commands with the camera 101 via the router 103. The LAN interface 402 has a function as an image receiving unit that sequentially receives image data such as live view image data F1 transmitted from the PC 102.

Further, the LAN interface 402 displays the live view image displayed on the finder unit 701 of the window 700 at the time when the zooming or focusing adjustment operation is stopped, and the state of the zoom lens and the focus lens of the photographing optical system 1011 of the camera 101. It has a function as an optical system setting transmission means for transmitting to the camera 101 as adjustment data (optical system setting information) J.
The LAN interface 402 has a function as a setting information receiving unit that receives live view image data F1 and the like transmitted from the camera 101 as setting information of the zoom lens and focus lens of the photographing optical system 1011.

The system memory 403 functions as a storage unit related to the operation of the PC 102, and temporarily holds image data received through the LAN interface 702, image data to be displayed on the display device 404, and the like.
The display device 404 is a display 1021 mounted on the PC 102. The display 1021 has a function as image display means for sequentially displaying image data such as live view image data F1 received through the LAN interface 402. That is, as shown in FIG. 2, the display 1021 displays a camera control software window 700. In this window 700, for example, a finder unit 701, a focus control switch 702, and a zoom control switch 703 are displayed. , A release button 704 is displayed. Of these, the viewfinder unit 701 displays the image data of the subject sent from the camera 101.

  The operation mechanism 405 receives an operation instruction for the zoom lens and the focus lens of the photographing optical system 1011 in the camera 101, for example, a command (operation instruction) H for increasing the zoom magnification, and a command (stop instruction) G for instructing to stop the operation for framing adjustment. It has a function as an operation means for emitting. The operation mechanism 405 is, for example, a mouse or a keyboard. The operation mechanism 405 can continuously give operation instructions to the zoom lens and the focus lens of the photographing optical system 1011 in the camera 101.

  Here, the CPU 401 performs the operation of the camera 101 based on the live view image data F1 displayed in the finder unit 701 of the display 1021 when the operation mechanism 405 is operated to stop the zoom operation, for example. A live view image is used as optical system setting information for specifying settings for the zoom lens and the focus lens of the photographing optical system 1011, and the optical view setting generation unit generates a live view image as adjustment data J.

  Further, when the CPU 401 continuously gives operation instructions to the zoom lens and the focus lens of the photographing optical system 1011 in the camera 101 by the operation mechanism 405, the zoom of the photographing optical system 1011 of the camera 101 is used as an optical system setting generation unit. Based on the point of time when the continuous operation for the lens and the focus lens is completed and the live view image data F1 displayed in the finder unit 701 of the display 1021 at the point of time when the continuous operation is finished, One frame of image data is generated as adjustment data J.

In the present embodiment, the live view image data F1 is used as it is as the adjustment data J. However, when the setting information of the photographing optical system 1011 is disabled in the live view image data F1, the CPU 401 determines the optical system. As the setting generation means, for example, adjustment is performed based on setting information associated with the live view image data F1 displayed in the finder unit 701 of the display 1021 when an operation such as stopping the operation for framing adjustment is performed. Data J can also be generated.
Next, the operation of the PC 102 as the operation device will be described with reference to the flowchart shown in FIG.
First, as shown in FIG. 3A, the PC 102 receives live view image data F1 from the camera 101 through the LAN interface 402, and displays the live view image in real time on the finder unit 701 of the window 700 in the display device 404. .

Next, in step S <b> 101, the CPU 401 of the PC 102 determines whether there is a zooming or focusing operation on the operation mechanism 405 by the user. That is, the CPU 401 of the PC 102 is in a state of waiting for an operation with respect to the operation mechanism 405.
Next, in step S <b> 102, the CPU 401 issues an operation instruction H command corresponding to the operation of the operation mechanism 405 by the user. For example, as shown in FIG. 2, when the “Δ” portion on the TEL end side of the zoom control switch 703 for zooming adjustment is pressed by the user's click operation with the mouse pointer, the PC 102 is shown in FIG. As described above, a command (operation instruction) H for raising the zoom magnification is issued to the camera 101 through the LAN interface 402. When the camera 101 receives a command (operation instruction) H for increasing the zoom magnification from the antenna 1012 through the WLAN module 204, for example, the camera 101 starts a zoom operation for moving the zoom lens to increase the zoom magnification. As described above, the camera 101 continues to transmit image data acquired by photographing a subject to the PC 102 as live view image data F1 via the wireless LAN router 103.

  Next, in step S <b> 103, the CPU 401 determines whether the user has stopped the zooming or focusing operation on the operation mechanism 405. As a result of this determination, for example, when the user stops the operation when the zoom control switch 703 reaches a position corresponding to the desired zoom magnification, the PC 102 releases the pointer to the zoom control switch 703 in step S104. At that time, one frame of image data of the live view image displayed on the finder 701 of the window 700 is held in the system memory 207 as adjustment data J. This adjustment data J is data indicating the state of the zoom lens and the focus lens in the photographing optical system 1011 of the camera 101 corresponding to one or both of zooming adjustment and focusing adjustment, for example.

  Next, in step S105, the CPU 401 issues a command (stop instruction) G for instructing to stop the operation for zooming adjustment to the camera 101 through the LAN interface 402 as shown in FIG. The adjustment data J, which is a live view image held in 303, is transmitted to the camera 101 through the LAN interface 402.

  As described above, the PC 101 executes the above steps S101 to S105 to execute one operation, for example, a series of controls for zooming adjustment, and repeatedly executes these steps S101 to S105 to control each of the focusing adjustments and the like. Execute.

Next, the operation of the camera 101 as the imaging apparatus will be described with reference to the flowchart shown in FIG.
The system controller 203 of the camera 101 continues to transmit image data obtained by photographing the subject as live view image data F1 from the WLAN module 204 to the PC 102 via the wireless LAN router 103.
At the same time, in step S201, the system controller 203 determines whether or not a zooming or focusing operation command H is received from the PC 102 through the WLAN module 204 under the control of the system controller 203. That is, the system controller 203 is in a state of waiting for receiving an operation command H from the PC 102.

  In this state, for example, when an operation command H for increasing the zoom magnification is received from the antenna 1012 through the WLAN module 204 as shown in FIG. 3B, the system controller 203 controls the pulse generator 309 by the CPU 302 in step S202. A zoom operation for increasing the zoom magnification by moving the zoom lens of the photographing optical system 1011 is executed.

Next, in step S203, the system controller 203 determines whether or not a zooming or focusing operation stop command G is received from the PC 102 through the WLAN module 204, for example, as shown in FIG.
As a result of this determination, upon receiving the operation stop command G, the system controller 203 immediately stops the zoom operation for increasing the zoom magnification by moving the zoom lens of the photographing optical system 1011 in step S204, and from the PC 102. The adjustment data J, which is one frame of image data of the transmitted live view image data, is received from the antenna 1012 through the WLAN module 204. The zoom operation is stopped by stopping the pulse generator 309 from generating pulses.

  In step S205, the system controller 203 adjusts the zoom lens and the focus lens in the photographing optical system 1011 so that the correlation between the adjustment data J from the PC 102 and the photographed image data is maximized.

  As described above, the system controller 203 executes the above steps S201 to S205 to execute one operation, for example, a series of controls for zooming adjustment, and repeats these steps S102 to S205 to perform focusing adjustment and the like. Execute each control.

Next, the adjustment of the zoom lens and the focus lens in the photographing optical system 1011 will be specifically described.
The system controller 203 of the camera 101 temporarily holds the adjustment data J transmitted from the PC 102 in the system memory 207.
The correlation detection circuit 307 is the image data that is the adjustment data J sent from the PC 102 and temporarily stored in the system memory 207, that is, the live view displayed on the finder 701 of the window 700 of the PC 102 when the operation is stopped. Correlation values between the adjustment data J, which is image data of one frame of the image, and the image data captured from the CCD 202 and stored in the system memory 207 by photographing with the CCD 202 are sequentially calculated.

At this time, the CPU 302 controls the pulse generator 309 to gradually move the zoom lens or the focus lens in the photographing optical system 1011 and detects the position where the correlation value detected by the correlation detection circuit 307 reaches a peak.
If this correlation value is detected in the entire image, the amount of calculation becomes enormous, so a part of the image data is used. 9A to 9D show images when the zoom magnification is changed with respect to the subject, for example. Each area E1 to E5 surrounded by a broken-line square shown in FIGS. 4A to 4D shows a portion where correlation is detected. For example, in the case of adjusting the zoom magnification, if the peak of the correlation value between the five areas E1 to E5 and the center area, for example, the area E3 and two areas other than the center area E3 can be detected, It is determined that the magnification matches the zoom magnification desired by the user.

  On the other hand, the focus adjustment can be performed, for example, by comparing the spatial frequencies of the central area E3. Of course, it is not limited to the central area E3 but may be an arbitrary area selected by the user, but a correlation peak needs to be detected.

  In this way, the PC 101 and the camera 101 control each other, and the camera 101 transmits image data to which data indicating the position of the zoom lens and the focus lens of the photographing optical system 1011 at the time when the operation is stopped is added. Then, the zoom lens position or the focus lens position when the operation is stopped on the PC 102 side is adjusted.

  As described above, according to the first embodiment, when the zooming and focusing operations on the camera 101 are stopped on the PC 102 side, for example, the operation stop command G is issued to the camera 101 and the zoom in the camera 101 is performed. Data indicating the state of the photographing optical system 1011 including the lens and the focus lens, here, the image data of the live view image displayed on the finder unit 701 of the window 700 when the operation is stopped, indicates the state of the optical system of the camera 101. The zoom lens and the focus lens in the photographing optical system 1011 are transmitted to the camera 101 as adjustment data J, and the camera 101 maximizes the correlation between the adjustment data J from the PC 102 and the photographed image data. Adjust.

  As a result, adjustment data J is generated based on the live view image F1 displayed on the viewfinder 701 of the window 700 on the PC 102 side, and the zoom lens and the focus lens in the photographing optical system 1011 in the camera 101 are adjusted. Therefore, it is possible to obtain the zooming and focusing state desired by the user without being affected by the delay of data communication in the network, and the operability does not deteriorate even when a still image is taken by operating from a remote place. Therefore, if the user who operates the PC 102 stops the operation at the position of the image that he / she thought is “here” while confirming the live view image F1, for example, based on the image data of the live view image F1 at the time when the operation was stopped. Thus, the zoom lens and the focus lens in the photographing optical system 1011 of the camera 101 are adjusted, and even if the network delay is large, zooming and focus can be manually adjusted reliably with a simple operation.

  Further, the PC 102 generates image data of the live view image F1 as adjustment data J as setting information of optical systems such as a zoom lens and a focus lens in the photographing optical system 1011 of the camera 101, and the adjustment data J and the camera 101 are generated. Since the correlation with the image data acquired by photographing is compared and the correlation value is maximized or the zoom lens and the focus lens in the photographing optical system 1011 of the camera 101 are adjusted to the peak position first found, the PC 102 It is not necessary to recognize the state of the photographing optical system 1011 of the camera 101 on the side, and the user can adjust the zoom lens and the focus lens in the photographing optical system 1011 to the position of the image that matches the image on the PC 102 side.

  Next, a second embodiment of the present invention will be described.

The present embodiment has the same configuration and control contents as the first embodiment, and the adjustment data J generation method and processing method are different. Hereinafter, a method for generating the adjustment data J and a processing method thereof will be described.
When transmitting the live view video F1, the camera 101 transmits the setting value of the photographing optical system 1011 including the focus lens and the zoom lens for each frame. This set value is generated by reading the value of the counter 310 by the CPU 302 in the system controller 203.

  When the PC 102 detects the stop of the operation with respect to the photographing optical system 1011 including the focus lens and the zoom lens from the operation mechanism 405, the PC 102 attaches to the image data of the live view video F1 displayed on the display device 404 at that time. The setting value of the photographic optical system 1011 is directly transmitted to the camera 101.

  When the camera 101 receives the setting value of the photographing optical system 1011, the camera 101 adjusts the focus lens and the zoom lens in the photographing optical system 1011 according to the setting value.

  As described above, according to the second embodiment, since the setting value of the photographing optical system 1011 attached to the image data of the live view video F1 is directly transmitted to the camera 101, it is necessary to adjust the photographing optical system 102. Time can be significantly reduced.

Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.
For example, in each of the above embodiments, the combination of the camera 101 and the PC 102 has been described. However, the present invention is not limited to this, and the photographing apparatus may be a PC or a mobile phone having a photographing function.
The data to be superimposed on the image data is not limited to the characteristics of the optical system such as the focus lens and the zoom lens in the photographing optical system 1011, and may be various optical system setting information of the camera 101. For example, the optical system setting information is not limited to data indicating the state of the zoom lens and the focus lens of the photographing optical system 1011 in the camera 101, and may include the aperture of the diaphragm, the shutter speed, and the like.

1 is a configuration diagram showing a first embodiment of a photographing system according to the present invention. FIG. The figure which shows an example of the display in the window displayed on the display of PC in the imaging | photography system. The figure which shows four phases of the outline of imaging | photography by the remote control of the imaging | photography system. The figure which shows the internal structure of the camera which comprises the imaging | photography system. FIG. 2 is a detailed configuration diagram inside a system controller of a camera constituting the photographing system. The block diagram which shows the component of PC in the imaging | photography system. 6 is a flowchart showing the operation of a PC in the same photographing system. 6 is a flowchart showing the operation of the camera in the photographing system. FIG. 4 is a schematic diagram showing images when a zoom magnification is changed, for example, with respect to a subject when a correlation value is detected by the imaging system.

Explanation of symbols

  101: Camera, 102: Personal computer (PC), 103: Router, 1011: Imaging optical system, 1012: Antenna, 1021: Display, 700: Window, 701: Viewfinder, 702: Switch for focus control, 703: Zoom control Switch, 704: release button, 202: CCD, 204: WLAN module, 205: TFT panel, 206: memory card, 207: system memory, 203: system controller, 208: setting switch, 209: release button, 210: encoder , 300: system bus, 301: CCD controller, 302: CPU, 303: image processing unit, 304: LCD controller, 305: SDRAM controller, 306: communication interface, 307: correlation Circuit output, 308: memory card interface, 309: pulse generator, 310: counter, 401: CPU, 402: LAN interface 403: system memory, 404: display device, 405: operating mechanism.

Claims (7)

In a photographing system having a photographing device for photographing a subject image and an operation device for operating the photographing device via a network,
The operating device includes image receiving means for sequentially receiving image data transmitted from the photographing device;
Image display means for sequentially displaying the image data received by the image receiving means;
Operation means for giving operation instructions to the optical system of the photographing apparatus;
Optical that generates, as optical system setting information, information that specifies settings for the optical system of the imaging device based on the image data displayed on the image display means when the operation means is operated. A system setting generation means;
Optical system setting transmission means for transmitting the optical system setting information to the photographing apparatus;
Comprising
The photographing apparatus includes photographing means for continuously photographing the subject image;
Image transmitting means for sequentially transmitting the image data acquired by photographing by the photographing means to the operating device;
Optical system setting receiving means for receiving the optical system setting information transmitted from the operating device;
Optical adjustment means for adjusting the optical system based on the optical system setting information received by the optical system setting reception means;
Comprising
An imaging system characterized by that. The optical system setting generation unit of the operation device generates the image data at the time when the operation unit is operated as the optical system setting information,
The optical adjustment unit of the photographing apparatus detects a correlation between the image data as the optical system setting information received by the optical system setting receiving unit and the image data acquired by photographing of the photographing apparatus. Correlation detection means;
An optical system set value calculating means for calculating a set value of the optical system with the highest correlation detected by the correlation detecting means;
Have
Adjusting the optical system based on the set value of the optical system calculated by the optical system set value calculating means;
The imaging system according to claim 1. The photographing device includes association means for associating setting information of the optical system at the time of photographing the subject image with the image data acquired at the time of photographing.
Setting information transmitting means for transmitting setting information of the optical system associated with the image data by the associating means;
With
The operating device includes setting information receiving means for receiving setting information of the optical system associated with the image data transmitted from the imaging device,
The optical system setting generation unit of the operation device generates the optical system setting information based on the setting information associated with the image data displayed on the image display unit at the time when the operation is performed. To
The imaging system according to claim 1. The operation device performs continuous operation on the optical system of the imaging device,
The optical system setting generation unit of the operation device is based on the time point when the continuous operation on the optical system ends and the image data displayed on the image display unit when the continuous operation ends. To generate the optical system setting information,
The imaging system according to claim 1.   The imaging system according to claim 1, wherein the optical system setting generation unit includes at least one of zooming and / or focusing information for the optical system of the imaging apparatus as the optical system setting information. In an operating device for operating a photographing device for photographing a subject image via a network,
Image receiving means for sequentially receiving image data transmitted from the photographing apparatus;
Image display means for sequentially displaying the image data received by the image receiving means;
Operation means for giving operation instructions to the optical system of the photographing apparatus;
Optical that generates, as optical system setting information, information that specifies settings for the optical system of the imaging device based on the image data displayed on the image display means when the operation means is operated. A system setting generation means;
Optical system setting transmission means for transmitting the optical system setting information to the photographing apparatus;
An operating device comprising: In a photographing device that receives an operation from an operation device via a network,
Photographing means for continuously photographing the subject image;
Image transmitting means for sequentially transmitting the image data acquired by photographing by the photographing means to the operating device;
Optical system setting receiving means for receiving the optical system setting information transmitted from the operating device;
Optical adjustment means for adjusting the optical system based on the optical system setting information received by the optical system setting reception means;
An imaging apparatus comprising:

Images