[go: up one dir, main page]

WO1999018719A1 - Procede et dispositif de transmission de donnees video ccd brutes, mises a l'echelle et comprimees, a partir d'une camera video - Google Patents

Procede et dispositif de transmission de donnees video ccd brutes, mises a l'echelle et comprimees, a partir d'une camera video Download PDF

Info

Publication number
WO1999018719A1
WO1999018719A1 PCT/US1998/020674 US9820674W WO9918719A1 WO 1999018719 A1 WO1999018719 A1 WO 1999018719A1 US 9820674 W US9820674 W US 9820674W WO 9918719 A1 WO9918719 A1 WO 9918719A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
color planes
separately
pixel data
color
Prior art date
Application number
PCT/US1998/020674
Other languages
English (en)
Inventor
Michael Shinsky
Michael Yukelson
Leonid Milenky
Original Assignee
Sony Electronics Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Electronics Inc. filed Critical Sony Electronics Inc.
Priority to AU97818/98A priority Critical patent/AU9781898A/en
Publication of WO1999018719A1 publication Critical patent/WO1999018719A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present invention relates to the field of transmission of video data. More particularly, the present invention relates to the field of transmission, scaling and compression of video data from a charge-coupled device.
  • FIG. 1 A schematic block diagram of a configuration including a video camera and a host computer is illustrated in Figure 1.
  • the video camera 10 includes a charge-coupled device (CCD) and is coupled to the host computer 20 for providing video data from the video camera 10 to the host computer 20.
  • the CCD 12 is coupled to a timing chip 14 which provides a clocking signal to the CCD 12.
  • the CCD 12 is also coupled to a sample and hold and analog-to-digital converter circuit 16.
  • the CCD 12 provides image data at a rate determined by the timing chip 14 to the sample and hold and analog-to-digital converter circuit 16. This image data is then sampled and converted into a digital format by the sample and hold and analog-to-digital converter circuit 16.
  • the sample and hold and analog-to-digital converter circuit 16 is coupled to a digital signal processing (DSP) circuit 18.
  • the DSP circuit 18 receives the digital data from the sample and hold and analog-to-digital converter circuit 16 and converts it into an appropriate video format, such as RGB, YC R C B , NTSC, PAL or any other appropriate format.
  • the DSP circuit 18 is then coupled to an interface circuit 19 for providing the video data for transmission from the video camera 10 to a device coupled to the video camera 10.
  • the video camera 10 is coupled to a host computer 20 through which the video data transmitted from the video camera 10 can be displayed on an associated display 36, saved and/or transmitted to another device.
  • the interface circuit 19 of the video camera 10 is coupled to an interface circuit 28 of the host computer 20 by a bus or cable for transmitting the video data from the video camera 10 to the host computer 20.
  • the host computer system 20, illustrated in Figure 1, is exemplary only and includes a central processor unit (CPU) 42, a main memory 30, a video graphics adapter (VGA) card 22, a mass storage device 32 and an interface circuit 28, all coupled together by a conventional bidirectional system bus 34.
  • the mass storage device 32 may include both fixed and removable media using any one or more of magnetic, optical or magneto-optical storage technology or any other available mass storage technology.
  • the system bus 34 contains an address bus for addressing any portion of the memory 30.
  • the system bus 34 also includes a data bus for transferring data between and among the CPU
  • the host computer system 20 is also coupled to a number of peripheral input and output devices including the keyboard 38, the mouse 40 and the associated display 36.
  • the keyboard 38 is coupled to the CPU 42 for allowing a user to input data and control commands into the computer system 20.
  • a conventional mouse 40 is coupled to the keyboard 38 for manipulating graphic images on the display 36 as a cursor control device.
  • the VGA card 22 interfaces between the components within the computer system 20 and the display 36.
  • the VGA card 22 converts data received from the components within the computer system 20 into signals which are used by the display 36 to generate images for display.
  • the data read out from the CCD 12 is provided to the sample and hold and analog-to-digital converter circuit 16 where it is converted into a digital format.
  • This digital data is raw video data representing the data read out from the CCD 12.
  • This digital data from the sample and hold and analog-to- digital converter circuit 16 is provided to the DSP circuit 18 where it is converted into the appropriate video data format before it is transmitted from the video camera 10.
  • the appropriate video format can include RGB, YC R C B , NTSC, PAL or any other appropriate format. Assuming eight (8) bit resolution per each color component or raw data, data in the RGB format requires twenty-four (24) bits per pixel and therefore three times as much bandwidth for transmission as the raw video data.
  • data in the YC R C B (4:2:2) format requires sixteen (16) bits per pixel and therefore one and a half to two times as much bandwidth for transmission compared to the raw video data.
  • it is desirable to transmit the raw video data from a video camera because it is the format requiring the lowest data rate and correspondingly, the least bandwidth.
  • Typical systems which receive video data from devices such as a video camera are not equipped to process the raw video data and convert it into the appropriate format for display. Accordingly, transmission of the raw video data from a
  • CCD camera to a receiving device is not used in typical systems.
  • the CCD 12 typically includes a Yellow-Cyan-Magenta-Green mosaic color filter, as is well known in the art. Using this mosaic filter, the CCD 12 captures color images and outputs data representing the color images. The color image data from the CCD 12 is combined into a tile structure, as illustrated in Figure 2.
  • This tile structure 50 provides raw video data representing the image captured by the CCD 12. From this tile structure 50, the luminance and chrominance components for the video data are obtained. Within the tile structure 50, pixels representing different colors are arranged adjacent to each other.
  • the raw video data in the tile structure of the CCD color space cannot be scaled or compressed without violating the tile structure of the frame represented by the raw video data. Compression requires a correlation of data between adjacent pixels, either horizontally or vertically. Data in the tile structure of the CCD color space does include some correlation. However, in its regular format, direct manipulation of raw data pixels in the tile structure of the CCD color space will lead to severe color and luminance errors, due to the adjacent relationship of colored pixels of different colors within the tile structure.
  • What is needed is a method of and apparatus for transmitting raw video data in a format which can be scaled and compressed. What is further needed is a method of and apparatus for transmitting raw video data to a receiving device which can appropriately convert and process the received data into the proper video format.
  • Raw CCD video data is transmitted from a video camera to a host computer.
  • the video camera does not include a digital signal processing circuit for processing the raw video data into the appropriate video format.
  • the raw CCD video data is processed and converted into the appropriate video format for display by the host computer after it is received from the video camera.
  • the raw video data for each frame is separated into four original color planes, each of which is transmitted separately to the host computer.
  • the raw video data is preferably separated by writing the frame data into a memory and then reading the data for each color plane separately from the memory.
  • Each of the original color planes consists of its own color component and can be scaled and compressed separately, as appropriate, before transmission from the video camera to the host computer.
  • the host computer when the separated, scaled and compressed video data is received, it is decompressed. After decompression of the received data, the decompressed data is then combined from the four original color planes into the raw video data representing the frame output from the CCD. The host computer then converts the received raw video data into the appropriate video format for display.
  • Figure 1 illustrates a schematic block diagram of a configuration including a CCD video camera and a host computer of the prior art.
  • Figure 2 illustrates a tile structure of a frame of color pixels read out from a CCD.
  • Figure 3 illustrates a schematic block diagram of a configuration of the preferred embodiment of the present invention including a CCD video camera and a host computer.
  • a video camera of the present invention includes the capability to transmit compressed and scaled raw CCD video data representing frames of images captured by the CCD.
  • the video camera does not include a DSP circuit for processing and converting the raw video data into the appropriate video format.
  • the raw video data is transmitted from the video camera to a host computer where it is processed and converted into the appropriate video format for display and/or transmission by the host computer.
  • the raw video data for each frame is separated into four original color planes, each of which is transmitted separately to the host computer.
  • the four original color planes are (Cyan + Magenta), (Green + Yellow), (Magenta + Yellow) and (Cyan + Green).
  • the four original color planes represent raw video data.
  • the raw video data is preferably separated by writing the frame data into a memory and then reading the data for the pixels of each color plane separately.
  • Each of the color planes consists of its own color component and can be scaled and compressed separately before transmission from the video camera to the host computer.
  • the host computer when the separated, scaled and compressed video data is received, it is decompressed and the four color planes for each frame are reconstructed.
  • the data is then combined from the four original color planes into the raw video data representing the frame output from the
  • the host computer then converts the received raw video data into the appropriate video format for display, storage and/or transmission.
  • FIG. 3 A schematic block diagram of a configuration of the preferred embodiment of the present invention, including a CCD video camera and a host computer, is illustrated in Figure 3.
  • the video camera 100 includes the CCD 12 and is coupled to the host computer
  • the video camera 100 does not include a DSP circuit for processing and converting the raw video data into an appropriate video format such as RGB, YC R C B , NTSC or PAL.
  • the CCD 12, the timing chip 14 and the sample and hold and analog-to-digital converter circuit 16 are all in the same configuration and perform the same functions as described above with respect to the video camera 10, illustrated in Figure 1.
  • the CCD 12 provides image data to the sample and hold and analog-to-digital converter circuit 16 representing images captured by the CCD 12. This image data is then sampled and converted into a digital format by the sample and hold and analog-to-digital converter circuit 16.
  • the sample and hold and analog-to-digital converter circuit 16 is coupled to the universal serial bus (USB) interface circuit 102.
  • USB universal serial bus
  • the USB interface circuit 102 is coupled to the memory circuit 104.
  • the memory circuit 104 is a dynamic random access memory.
  • the memory circuit 104 is any appropriate memory circuit or device.
  • the raw video data from the sample and hold and analog-to-digital converter circuit 16 is written into the memory circuit 104 from the USB interface circuit 102.
  • the raw video data is read from the memory circuit 104 for each color plane by separately reading the pixel data corresponding to each color plane.
  • the pixel data within the color plane is scaled and compressed as necessary for the particular implementation.
  • each color plane consists of the same color component and therefore there is a correlation between adjoining pixels, allowing the pixel data of each separate color plane to be scaled and compressed without destroying the tile structure of the video data.
  • the data representing each separate color plane is transmitted to the host computer 200.
  • the USB 106 is used to transmit the data from the USB interface circuit 102 in the video camera 100 to the USB interface circuit 202 in the host computer 200.
  • any other appropriate connection can be used to transmit data from the video camera 100 to the host computer 200.
  • the data is preferably written into the main memory 30 and then processed by the host computer 200.
  • the host computer 200 includes the software and components necessary to process and convert the received data. The received data is decompressed by the host computer 200, if necessary.
  • the decompressed data representing the four original color planes of the frame is then combined into the tile structure of the raw video data, representing the frame image output from the CCD 12.
  • This raw video data is then processed and converted by the host computer 200 into the appropriate video format, e.g., RGB, YC R C B , NTSC, PAL or any other appropriate format. After this conversion, the data is then displayed by the host computer 36, saved in the mass storage device 32 or transmitted to another device, as appropriate.
  • the four original color planes are preferably decompressed separately, before they are combined into the tile structure of the frame of raw video data.
  • the host computer 200 then performs the appropriate steps to convert raw video data into the appropriate video format. This is the conversion that was performed by the DSP 18 in the video camera of Figure 1.
  • the appropriate steps for this conversion depend on the video format to which the data is being converted and are well known by those skilled in the art.
  • the conversion from raw video data to the appropriate video format is performed by software resident in the host computer 200.
  • any other appropriate conversion implementation can be used, as will be apparent to those skilled in the art.
  • the preferred receiver of the raw video data is the host computer 200, this data can also be transmitted to, received and converted by any other appropriately configured device.
  • the original frame tile structure is written into and read from the memory 104 in order to separate the frame into the four original color planes.
  • the memory 104 In the preferred embodiment of the present invention, there are many other methods and implementations which can be used to separate the raw video data into the four original color planes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Systems (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

Selon l'invention, des données brutes de caméra à DCC (12) (dispositif à couplage de charge) sont transmises d'une caméra vidéo (100) vers un ordinateur hôte (200). Cette caméra vidéo ne comporte pas de circuit de traitement de signaux numériques pour traiter les données vidéo brutes et les mettre sous le format vidéo approprié. Les données brutes de la caméra à DCC sont traitées et converties dans le format vidéo approprié, aux fins d'affichage par l'ordinateur hôte, après avoir été reçues à partir de la caméra vidéo. Avant transmission à partir de la caméra vidéo, les données vidéo brutes sont séparées pour chaque trame en quatre plans couleur d'origine, chacun d'entre eux étant transmis séparément vers l'ordinateur hôte. De préférence, ces données vidéo brutes sont séparées par écriture des données de trame dans une mémoire (104), puis lecture de ces données, pour chaque plan de couleur, séparément, à partir de la mémoire. Chaque plan couleur comprend sa propre composante couleur et peut être mis à l'échelle et comprimé séparément, de manière adéquate, avant transmission à partir de la caméra vidéo vers l'ordinateur hôte. Au niveau de cet ordinateur, lorsque les données vidéo séparées, mises à l'échelle et comprimées sont reçues, elles sont décomprimées. Après décompression des données reçues, les données décomprimées sont alors combinées, à partir des quatre plans couleur d'origine, en données vidéo brutes représentant la sortie des trames à partir du dispositif à DCC. L'ordinateur hôte convertit ensuite les données vidéo brutes reçues en un format vidéo approprié, aux fins d'affichage (36).
PCT/US1998/020674 1997-10-07 1998-09-28 Procede et dispositif de transmission de donnees video ccd brutes, mises a l'echelle et comprimees, a partir d'une camera video WO1999018719A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU97818/98A AU9781898A (en) 1997-10-07 1998-09-28 Method of and apparatus for transmitting scaled and compressed raw ccd video data from a video camera

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US94630197A 1997-10-07 1997-10-07
US08/946,301 1997-10-07

Publications (1)

Publication Number Publication Date
WO1999018719A1 true WO1999018719A1 (fr) 1999-04-15

Family

ID=25484281

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1998/020674 WO1999018719A1 (fr) 1997-10-07 1998-09-28 Procede et dispositif de transmission de donnees video ccd brutes, mises a l'echelle et comprimees, a partir d'une camera video

Country Status (2)

Country Link
AU (1) AU9781898A (fr)
WO (1) WO1999018719A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1530376A4 (fr) * 2002-06-18 2006-05-24 Nokia Corp Dispositif et procede de traitement d'images, dispositif de sortie d'images, camera numerique, et terminal de donnees mobile utilisant ceux-ci
US7589858B2 (en) 2002-06-18 2009-09-15 Nokia Corporation Image processing apparatus and method, image output unit, as well as digital camera and portable terminal using the image processing apparatus and output unit
US7843508B2 (en) 2002-07-23 2010-11-30 Mediostream, Inc. Method and system for direct recording of video information onto a disk medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5016107A (en) * 1989-05-09 1991-05-14 Eastman Kodak Company Electronic still camera utilizing image compression and digital storage
US5253047A (en) * 1990-09-14 1993-10-12 Sony Corporation Color CCD imager having a system for preventing reproducibility degradation of chromatic colors
US5402171A (en) * 1992-09-11 1995-03-28 Kabushiki Kaisha Toshiba Electronic still camera with improved picture resolution by image shifting in a parallelogram arrangement
US5457494A (en) * 1988-11-21 1995-10-10 Canon Kabushiki Kaisha Image pickup signal processing apparatus
US5628603A (en) * 1994-11-30 1997-05-13 Fluor Corporation Automated chute system
US5668596A (en) * 1996-02-29 1997-09-16 Eastman Kodak Company Digital imaging device optimized for color performance

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5457494A (en) * 1988-11-21 1995-10-10 Canon Kabushiki Kaisha Image pickup signal processing apparatus
US5016107A (en) * 1989-05-09 1991-05-14 Eastman Kodak Company Electronic still camera utilizing image compression and digital storage
US5253047A (en) * 1990-09-14 1993-10-12 Sony Corporation Color CCD imager having a system for preventing reproducibility degradation of chromatic colors
US5402171A (en) * 1992-09-11 1995-03-28 Kabushiki Kaisha Toshiba Electronic still camera with improved picture resolution by image shifting in a parallelogram arrangement
US5628603A (en) * 1994-11-30 1997-05-13 Fluor Corporation Automated chute system
US5668596A (en) * 1996-02-29 1997-09-16 Eastman Kodak Company Digital imaging device optimized for color performance

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1530376A4 (fr) * 2002-06-18 2006-05-24 Nokia Corp Dispositif et procede de traitement d'images, dispositif de sortie d'images, camera numerique, et terminal de donnees mobile utilisant ceux-ci
US7589858B2 (en) 2002-06-18 2009-09-15 Nokia Corporation Image processing apparatus and method, image output unit, as well as digital camera and portable terminal using the image processing apparatus and output unit
US7843508B2 (en) 2002-07-23 2010-11-30 Mediostream, Inc. Method and system for direct recording of video information onto a disk medium
US8619188B2 (en) 2002-07-23 2013-12-31 Mediostream, Inc. Method and system for direct recording of video information onto a disk medium

Also Published As

Publication number Publication date
AU9781898A (en) 1999-04-27

Similar Documents

Publication Publication Date Title
US6452632B1 (en) Solid state image sensor and video system using the same
JP3542653B2 (ja) 電子スチルカメラにおける画像データ伝送システム
JP3839526B2 (ja) ディジタルカメラ
US5920343A (en) Imaging system with image processing for re-writing a portion of a pixel block
CN101572826B (zh) 超声视频显示装置和方法
US8130317B2 (en) Method and system for performing interleaved to planar transformation operations in a mobile terminal having a video display
JPH1075430A (ja) ビデオデータ処理装置およびビデオデータ表示装置
US7688334B2 (en) Method and system for video format transformation in a mobile terminal having a video display
US7236194B2 (en) Image signal processing apparatus
US20060232808A1 (en) Imaging module, interface, and method handling multiple simultaneous data types
JPS59205881A (ja) 電子式スチル記憶方式
US5193012A (en) Real-time conversion of still-video to half-tone for hard copy output (such as on a facsimile machine)
WO1999018719A1 (fr) Procede et dispositif de transmission de donnees video ccd brutes, mises a l'echelle et comprimees, a partir d'une camera video
US7391932B2 (en) Apparatus and method for selecting image to be displayed
US6754267B1 (en) Image processing apparatus
US5583569A (en) Video camera having asynchronous digital output including header data
JPH0690435A (ja) 画像再生装置
JP2007221685A (ja) デジタルカメラ及びその制御方法
KR100320151B1 (ko) 다중 영상신호저장 제어장치
JP2006304203A (ja) 色差間引きの変換機能を有する電子カメラ
JPH0944634A (ja) 映像入力装置
KR200182088Y1 (ko) 다중 영상신호저장 제어장치
KR101025774B1 (ko) 비데오 프리젠터로부터의 영상 데이터를 효율적으로처리하는 방법
JP3745605B2 (ja) 電子スチルカメラ
KR101012707B1 (ko) 비데오 프리젠터로부터의 영상 데이터를 효율적으로처리하는 방법

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
NENP Non-entry into the national phase

Ref country code: KR

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA