[go: up one dir, main page]

WO1998029819A1 - Inspection eloignee en temps reel d'images haute resolution - Google Patents

Inspection eloignee en temps reel d'images haute resolution Download PDF

Info

Publication number
WO1998029819A1
WO1998029819A1 PCT/IB1997/001607 IB9701607W WO9829819A1 WO 1998029819 A1 WO1998029819 A1 WO 1998029819A1 IB 9701607 W IB9701607 W IB 9701607W WO 9829819 A1 WO9829819 A1 WO 9829819A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
hierarchy
level
areas
Prior art date
Application number
PCT/IB1997/001607
Other languages
English (en)
Inventor
Andrea Basso
Raffaele Noro
Olivier Verscheure
Jean-Pierre Hubaux
Original Assignee
Ecole Polytechnique Federale De Lausanne
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ecole Polytechnique Federale De Lausanne filed Critical Ecole Polytechnique Federale De Lausanne
Priority to AU54058/98A priority Critical patent/AU5405898A/en
Priority to EP97947822A priority patent/EP0946919A1/fr
Publication of WO1998029819A1 publication Critical patent/WO1998029819A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/532—Query formulation, e.g. graphical querying
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2166—Intermediate information storage for mass storage, e.g. in document filing systems

Definitions

  • This invention relates to Real-Time Remote Inspection of High-Resolution Images and more particularly to coordinated storage, retrieval and transmission of digital images with different levels of resolution.
  • the interactivity is handled by letting the user to select, within a low-resolution version of the image he/she is interested in, only a portion of the image to be viewed with higher resolution or higher priority with respect to the remainder: this implies a hierarchical structure of the image data as well as the definition of Region of Interest (Rol) that indicates a specific portion of the image to be viewed at higher resolution.
  • Rol Region of Interest
  • the Rol have two possible interpretations: in the first, the Rol is viewed in a display window independent from the low-resolution image while in the second, the Rol is displayed within the same display window but with an enhanced level of resolution for the specific region (EP-A-0 246 010 and WO-A-96 29818 teach about said second interpretation).
  • the aim of the present invention is to provide coordinated integrated storage, retrieval and transmission methods to support the decoding operations required in particular by [1], although it is not exclusively targeted to the mentioned system.
  • a system that receives a hierarchy of images at different resolution levels, either in original or coded format, and, by using only index numbers as identificators of portions of images, establishes direct relationships between corresponding areas in all consecutive levels of the hierarchy, before the storage in the database. It is also addressed a system for retrieving in a second time both full images and Rol that are selected by the user through the display apparatus. Finally, it is addressed a system for the interactive transmission of images or Rol as a sequence of consecutive elementary areas.
  • the first object of this invention is to provide a suitable technique for the storage of high-resolution images that are generated by the image source as a hierarchy of digital images.
  • the second object of this invention is to provide a suitable technique for retrieving images and portion of images that are organised in a hierarchical structure in a storage apparatus.
  • the third object of this invention is to provide a suitable technique for the transmission to a display apparatus of images and portion of images that are retrieved from a storage apparatus and are organised in a hierarchical structure.
  • a method for storage, retrieval and transmission comprising: the steps of receiving hierarchical digital image data from the source, where images are analysed and further decomposed as a set of elementary areas in which any such area in one image at a given level of the hierarchy corresponds to a group of elementary areas in the upper level of the hierarchy and in which for each image of the hierarchy, consecutive elementary areas are sorted out in a first file, whereas the position in said first file of each area is indexed in a second file and the length in bytes of each area is stored in a third file; the steps of passing and storing the index file and the length file of the areas in each image of the hierarchy in which these files are further used when retrieving from the storage means a portion of a given image in the hierarchy selected by a control signal issued by the display apparatus and where the selection refers to an images or a portion of an image at a coarser resolution level in the hierarchy; the steps of buffering the requested portion of images at higher resolution where the elementary areas are organised in order to form
  • the first object of the invention is more particularly achieved by the steps of storing digital hierarchies of images corresponding to increasing resolution levels in which the whole information content of the image is aggregated as a set of indexes, each of them corresponding to one and only one elementary area and where:
  • the step of storing digital hierarchies of images may be a step of storing hierarchies of uncoded images in the form of consecutive elementary areas of M x N pixels, independently from the hierarchical level, or a step of storing hierarchies of coded images where elementary areas are obtained through a mask composed of consecutive regular rectangles of M x N pixels.
  • the image at level i may be stored as a set of consecutive regular elementary areas for which an index is produced in the increasing order from 0 to H j x V j , where H j and V j are respectively the number of areas in the horizontal and vertical directions.
  • An index may be associated and used to identify a unique elementary area of the image at level i and in which this index corresponds to Zj 2 indexes of the image at level i-1 and each image may be decomposed as a set of indexed elementary areas and for each index the length in bytes may be written in a file at the corresponding index value.
  • each image may be decomposed in a set of indexed elementary areas and for each index the position of the first byte of the information relative the indexed area may be written in a file at the corresponding index value.
  • the second object of the invention is more particularly achieved by retrieving steps for stored hierarchies of images where:
  • the hierarchy is stored as a unique file for each coded or uncoded image in the order of consecutive elementary areas
  • the display apparatus queries images or portion of images in the increasing order of resolution level
  • the image at the lowest resolution level n may be used to define a portion of the image at level n-1 in the form of a rectangular mask defined by the upper-left x 1 t y 1 and bottom-right x 2 , y 2 corners.
  • any level i of the hierarchy may be defined a portion of the image at level i-1 to be retrieved as a rectangular area x 1 ( y ⁇ , x 2 , ⁇ 2 , until the level 1 of the hierarchy is reached.
  • the queries may be received from the display apparatus as a query of a rectangular area x 1 , y 1 ; x 2 , y 2 of the image at level i that is mapped into a corresponding rectangular area x ⁇ , y.,', x 2 ', y 2 ' of the image i-1 to be retrieved, and a rectangular area x ⁇ , y ⁇ , x 2 ', y 2 ' of the image at level i-1 of the hierarchy may be mapped into a set of indexed areas for which the indexes are in the increasing order and the set of elementary areas covers the defined rectangle.
  • the database may be queried for a portion of an image in the form of a set of rectangular elementary areas and this elementary areas may be identified as index numbers in the increasing order and in which the index is associated with the position and length of the elementary area to be retrieved.
  • the database may be queried for a portion of an image in the form of a set of elementary areas, where the indexed elementary areas are identified by indexed positions and lengths to be retrieved without any specific ordering.
  • a sequence of portions of the same reference image may be queried.
  • the third object of the invention is more particularly achieved by the steps of temporarily storing the information relative to the elementary area to be transmitted in a buffer organised to store the exact amount of information to be transmitted when buffer is filled up.
  • the buffer may be organised as consecutive indexed slots in the increasing indexing order, each slot corresponding to an indexed length.
  • the transmission may be organised for sending the data contained in the buffer and data being readout in the increasing index order.
  • Fig. 1 is a block diagram of a preferred embodiment of the method of the present invention.
  • Fig. 2 represents the operations performed in storage mode, where the Y j x X j image of level i is decomposed in H j x V ( elementary areas of size M x N pixels.
  • Fig. 3 represents the mapping of one M x N elementary area of level i with Z j 2 elementary areas of level i-1 , where Z j is the zooming factor between image at level i and image at level i-1 .
  • Fig. 4 represents the selection of the active elementary areas in the image at level i- 1 once the selection is performed in the image at the level i .
  • the rectangle x ⁇ , y-,', x 2 ', y 2 ' is derived from the reference image, then the indexes of the active elementary areas are computed.
  • Fig. 5 represents the set of indexes that are queried to the database after the selection and the computation of active elementary areas on the reference image.
  • Fig. 6 represents the buffer space allocated for each control signal received from the display apparatus, once the selection on the reference image has been performed, as well as the queries to the storage apparatus have been sent: the selected elementary areas are received from the database and placed in the appropriate slot, until the buffer is filled up.
  • Block 1 is the source of images in hierarchical format
  • block 2 is the storage system of the invention
  • block 3 is the storage apparatus
  • block 4 is the memory that stores the length and position of the indexed elementary areas for subsequent retrieval
  • block 5 generates the control signals received from the display apparatus
  • block 6 is the retrieval system of the invention
  • block 7 is the memory to organise the buffer slots of the retrieved elementary areas
  • block 9 is the transmission support
  • block 10 is the display apparatus.
  • the method for storage, retrieval and transmission of the present invention includes the following described methods in storage, retrieval and transmission modes.
  • the storage apparatus is composed of one or several disks and/or CD juke-box that permanently store any digital information, in particular high-resolution images in the embodiment of the invention.
  • the method in the storage mode is receiving the hierarchy of digitised images from the image source, either in original or coded format.
  • the image with the lowest resolution level, say In is analysed first and subdivided into elementary areas of equal size M x N pixels to form a regular grid (Fig. 2).
  • Each area of the grid is then indexed starting from the upper-left corner with the number zero and increasing the index for the consecutive areas in the horizontal direction or for the left area of the following line of the grid if the right image border is reached.
  • the number of areas in the horizontal scan and in the vertical scan are, respectively:
  • X n is the horizontal size in pixels
  • Y n is the vertical size in pixels
  • the method in storage mode For each indexed area, the method in storage mode generates a trace of the length l k , in number of bytes, occupied by the k-th indexed area of the image (such length is the same for all areas if the image is in uncompressed format).
  • the elementary areas are then sent to the storage apparatus in their exact indexing order, so that the consecutive bytes of each area are adjacent for the subsequent retrieval and transmission.
  • each given area of the image l j is covered by the low-resolution version of an aggregation of an integral number of elementary areas in the image lj. 1 t thereof if the zooming factor from image l j to image l is Z j in both the horizontal and vertical axes, each elementary area in l j corresponds to Z j 2 elementary areas in l ⁇ (Fig. 3).
  • the method computes the position and the length, in number of bytes, of the indexed areas in the order they are sent to the storage apparatus. These positions and lengths are then recorded and sent as two distinct files to the retrieval module for subsequent hierarchical access to the images.
  • the method in retrieval mode is remotely controlled by a user and is receiving control signals from the display apparatus.
  • the storage apparatus contains all the information that can be potentially accessed at a given instant by the user in the hierarchy of resolution levels, to be displayed either as separate windows for separate resolution levels or in the same window with enhanced resolution levels.
  • control signal issued by the user through the display apparatus represents a request for zooming within the image l j at the resolution level i , the rectangular region defined by his upper-left corner x ⁇ y ⁇ and his bottom-right corner x 2 , y 2 .
  • the method operates as follows: for the image l n with the lowest resolution level, the retrieval system reads from the storage apparatus l k consecutive bytes at the position p k , where k ranging from 0 to (H n x V n )-1 is the index of the elementary areas in that image and p k and l k are respectively the position and the length in bytes of the k-th indexed elementary area as contained in the retrieval memory of the method; in subsequent operations and with reference to the image l j in the i-th level of the hierarchy, the retrieval is performed under control of the display apparatus that indicates simultaneously the level i of the reference image, the upper-left and bottom-right corner of the rectangular area x 1 t y ⁇ x 2 , y 2 to be viewed with magnification; the indexes of the elementary areas of the image l j .-, to be then displayed are computed from the index of the upper-left corner of the portion of image lj already displayed (Fig.
  • x MOD y is the remainder of x/y
  • DIV y is the integral part x/y
  • index entries activate the corresponding entries in the position and length files of the image l ⁇ contained in the retrieval memory that queries the storage apparatus.
  • the image data in the storage apparatus is accessed in the order of increasing index, reading in the storage apparatus the data file corresponding to the image l at the indexed position and at the indexed length in bytes.
  • the following operation is the transmission of the elementary areas to the display apparatus.
  • the method in the transmission mode controls a buffer in which the information relative to the elementary area being transmitted is temporarily stored before accessing the transmission means.
  • the allocated buffer space corresponds to the sum of all the lengths of the elementary areas that have been requested by the retrieval module and each area and buffer slot are sorted in the order of their increasing index.
  • the transmission operates as follows: the indexed areas enters the transmission buffer in their request order, if storage apparatus is synchronous with the retrieval module, or in a random order, if not, and are put in the corresponding location of the buffer since we know from the index the position and length of all the elementary areas (Fig. 6); when the buffer is filled up and ready to be transmitted, the bytes are then delivered to the transmission means and in turn to the display means. The system stops until the next control signal is received from the display apparatus.
  • the invention has several domains of applicability, generally those in which the inspection of high resolution images is a current practice and in particular when such information have to be stored in a central database for future multiple access, such as:
  • the required means are: a computer unit located near the storage apparatus to process digital images in hierarchical format where either original or incremental or coded formats are equally supported, since it is a task of the display apparatus to process the content of the images; storage means to store the information that is processed by the computer unit and accessed later; a computer unit to receive controls from the display apparatus and query data to the storage means; buffer means to structure the information to be sent to the display apparatus; transmission means to carry information from the buffer to the display apparatus and to carry control signals from the display apparatus to a computer unit.
  • the benefits of using the method of the present invention include:

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Storing Facsimile Image Data (AREA)

Abstract

L'invention concerne un procédé de stockage, extraction et transmission se décomposant en plusieurs étapes: une étape de réception de données d'image numérique hiérarchisées provenant d'une source (1), dans laquelle les images sont analysées et décomposées sous forme d'ensemble de zones élémentaires correspondant, à un niveau hiérarchique donnée, à un groupe de zones élémentaires dans le niveau supérieur de la hiérarchie et dans laquelle, pour chaque image de la hiérarchie, des zones élémentaires consécutives sont éliminées par tri dans un premier fichier, la position dans ledit fichier de chaque zone étant répertoriée dans un deuxième fichier et le longueur en octets de chaque zone étant mémorisée dans un troisième fichier; les étapes de transfert et de mémorisation du fichier répertoire et du fichier longueur des zones dans chaque image de la hiérarchie, ces fichiers étant encore utilisés lors de l'extraction du moyen de stockage (3) d'une partie d'une image donnée de la hiérarchie sélectionnée par un signal de commande (5) produit par l'appareil d'affichage (10), la sélection se référant à une image ou à une partie d'une image à un niveau de résolution plus faible dans la hiérarchie; des étapes de mise en mémoire tampon de la partie demandée des images avec une résolution plus élevée, les zones élémentaires étant organisées de sorte que soit formée une séquence de zones consécutives à transmettre par le moyen de transmission (9) approprié à l'appareil d'affichage.
PCT/IB1997/001607 1996-12-30 1997-12-30 Inspection eloignee en temps reel d'images haute resolution WO1998029819A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU54058/98A AU5405898A (en) 1996-12-30 1997-12-30 Real-time remote inspection of high-resolution images
EP97947822A EP0946919A1 (fr) 1996-12-30 1997-12-30 Inspection eloignee en temps reel d'images haute resolution

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB9627037.6 1996-12-30
GBGB9627037.6A GB9627037D0 (en) 1996-12-30 1996-12-30 Real-time interactive remote inspection of high-resolution images

Publications (1)

Publication Number Publication Date
WO1998029819A1 true WO1998029819A1 (fr) 1998-07-09

Family

ID=10805102

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB1997/001607 WO1998029819A1 (fr) 1996-12-30 1997-12-30 Inspection eloignee en temps reel d'images haute resolution

Country Status (4)

Country Link
EP (1) EP0946919A1 (fr)
AU (1) AU5405898A (fr)
GB (1) GB9627037D0 (fr)
WO (1) WO1998029819A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003012680A1 (fr) * 2001-08-02 2003-02-13 Singfield Christian Robert Mau Serveur d'images de reseau
WO2003088652A1 (fr) * 2002-04-09 2003-10-23 Sonic Solutions Ensemble d'images zoomees pouvant etre explorees par un utilisateur final derivees a partir d'une image maitresse haute resolution
EP1898339A4 (fr) * 2005-06-30 2008-03-12 Olympus Corp Système et procédé de récuperation

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005053148B4 (de) * 2005-11-04 2022-12-22 Robert Bosch Gmbh Verfahren zur Handhabung von Inhaltsinformationen

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0152355A2 (fr) * 1984-02-14 1985-08-21 Nippon Telegraph And Telephone Corporation Appareil pour recherche et représentation d'information image
DE4002179A1 (de) * 1989-01-25 1990-08-02 Hitachi Ltd Verfahren und vorrichtung zum wiederauffinden von bilddaten
US5165103A (en) * 1986-09-12 1992-11-17 Hitachi, Ltd. Image data processing method for selective partial image storage
WO1994003010A1 (fr) * 1992-07-20 1994-02-03 Automated Medical Access Corporation Systeme automatise de stockage, recherche et transmission d'images a haute definition/resolution
US5313572A (en) * 1989-12-26 1994-05-17 Fuji Xerox Co., Ltd. Filing storage and retrieval equipment and apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0152355A2 (fr) * 1984-02-14 1985-08-21 Nippon Telegraph And Telephone Corporation Appareil pour recherche et représentation d'information image
US5165103A (en) * 1986-09-12 1992-11-17 Hitachi, Ltd. Image data processing method for selective partial image storage
DE4002179A1 (de) * 1989-01-25 1990-08-02 Hitachi Ltd Verfahren und vorrichtung zum wiederauffinden von bilddaten
US5313572A (en) * 1989-12-26 1994-05-17 Fuji Xerox Co., Ltd. Filing storage and retrieval equipment and apparatus
WO1994003010A1 (fr) * 1992-07-20 1994-02-03 Automated Medical Access Corporation Systeme automatise de stockage, recherche et transmission d'images a haute definition/resolution

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
BASSO ET AL: "A Multimedia Architecture for Medical Tele-imaging over ATM", CAR '96 COMPUTER ASSISTED RADIOLOGY, PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON COMPUTER AND COMMUNICATIONS SYSTEMS FOR IMAGE GUIDED DIAGNOSIS AND THERAPY, June 1996 (1996-06-01), PARIS, FRANCE, pages 519 - 524, XP002059989 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003012680A1 (fr) * 2001-08-02 2003-02-13 Singfield Christian Robert Mau Serveur d'images de reseau
WO2003088652A1 (fr) * 2002-04-09 2003-10-23 Sonic Solutions Ensemble d'images zoomees pouvant etre explorees par un utilisateur final derivees a partir d'une image maitresse haute resolution
US7343052B2 (en) 2002-04-09 2008-03-11 Sonic Solutions End-user-navigable set of zoomed-in images derived from a high-resolution master image
EP1898339A4 (fr) * 2005-06-30 2008-03-12 Olympus Corp Système et procédé de récuperation

Also Published As

Publication number Publication date
GB9627037D0 (en) 1997-02-19
AU5405898A (en) 1998-07-31
EP0946919A1 (fr) 1999-10-06

Similar Documents

Publication Publication Date Title
US4661811A (en) Video map display
CA1315391C (fr) Systeme de traitement d'informations de types divers sous forme facilement utilisable
US6005679A (en) Image data filing system for quickly retrieving an area of interest of an image from a reduced amount of image data
WO1990013876A1 (fr) Procede et appareil de manipulation de donnees video numeriques
JPH05501932A (ja) 低解像度インデックス・イメージ・データを有するイメージ・データベース
EP0217825A1 (fr) Systeme de gestion de dessins utilisant un ordinateur
Hill Jr et al. Interactive image query system using progressive transmission
JP4510266B2 (ja) 情報記録方法及び情報記録装置
US6731808B2 (en) Compressed storage of data items
EP0946919A1 (fr) Inspection eloignee en temps reel d'images haute resolution
US5255364A (en) Electronic filing system wherein the automatic updating of retrieval data is voluntarily inhibited
EP0517383A2 (fr) Compression et stockage d'images
JPS63156476A (ja) 画像フアイル装置
CN1033549C (zh) Gps导航仪
KR20010035015A (ko) 다수 데이터의 통합 영상 디스플레이 시스템 및 방법
JPH05502568A (ja) 読取り装置
JPS648854B2 (fr)
JPS61151890A (ja) 文書画像情報の検索方法
KR100563085B1 (ko) 수치지도와 사진영상의 복합 디스플레이 방법
JPH05103233A (ja) 資料映像による映像製作装置
KR20010000208A (ko) 거대 영상 디스플레이 시스템 및 방법
JP3450346B2 (ja) 異縮尺地図管理装置
JPH02301873A (ja) イメージ処理装置
GB2034941A (en) Information storage and retrieval system
JPH0520371A (ja) 情報検索結果表示方法

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU JP NO US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 09331965

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 1997947822

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1997947822

Country of ref document: EP

WWR Wipo information: refused in national office

Ref document number: 1997947822

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1997947822

Country of ref document: EP