CN201662682U - Stereo pick-up device - Google Patents
Stereo pick-up device Download PDFInfo
- Publication number
- CN201662682U CN201662682U CN2010201732574U CN201020173257U CN201662682U CN 201662682 U CN201662682 U CN 201662682U CN 2010201732574 U CN2010201732574 U CN 2010201732574U CN 201020173257 U CN201020173257 U CN 201020173257U CN 201662682 U CN201662682 U CN 201662682U
- Authority
- CN
- China
- Prior art keywords
- plane
- lens group
- imaging lens
- plane mirror
- optical imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012634 optical imaging Methods 0.000 claims abstract description 42
- 230000003287 optical effect Effects 0.000 claims abstract description 36
- 230000000295 complement effect Effects 0.000 claims description 2
- 229910044991 metal oxide Inorganic materials 0.000 claims description 2
- 150000004706 metal oxides Chemical class 0.000 claims description 2
- 239000004065 semiconductor Substances 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 abstract description 8
- 238000000034 method Methods 0.000 description 6
- 230000015572 biosynthetic process Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 208000012886 Vertigo Diseases 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 231100000889 vertigo Toxicity 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B35/00—Stereoscopic photography
- G03B35/08—Stereoscopic photography by simultaneous recording
- G03B35/10—Stereoscopic photography by simultaneous recording having single camera with stereoscopic-base-defining system
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B17/00—Systems with reflecting surfaces, with or without refracting elements
- G02B17/02—Catoptric systems, e.g. image erecting and reversing system
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Studio Devices (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
The utility model discloses a stereo pick-up device, which comprises a camera module, a first planar reflector, a second planar reflector, a third planar reflector and a fourth planar reflector; the camera module comprises an optical imaging lens group and an optical sensor; the mirror surface of the first planar reflector is parallel to the mirror surface of the second planar reflector; the mirror surface of the third planar reflector is parallel to the mirror surface of the fourth planar reflector; the first planar reflector, the second planar reflector, the third planar reflector and the fourth planar reflector are installed in front of the optical imaging lens group; and the optical imaging lens group is installed in front of the optical sensor. By adopting the utility model, not only the consistency on an imaging optical path can be ensured, but also the completely consistent electrical performance of shot images can be ensured.
Description
Technical Field
The utility model relates to a three-dimensional imaging technology field especially indicates a three-dimensional camera device.
Background
With the increasing maturity of digital imaging technology, stereo imaging technology is rapidly developing. The stereo imaging technology is mainly realized by using the parallax characteristics of two eyes of a person, and the specific realization mode mainly comprises the following steps: a color separation method, a light separation method, a time division method, a grating method, and the like. Although there are various specific implementation manners, the principles of all the implementation manners are similar, namely: two parallel cameras are used for synchronously shooting two pictures with slight horizontal parallax, and the two cameras respectively represent the left eye and the right eye of a person. When in showing, the two pictures are respectively arranged in a left-eye showing device and a right-eye showing device, the left-eye showing device and the right-eye showing device synchronously operate, and the pictures are simultaneously shown to form a double-shadow image comprising a left-eye image and a right-eye image. Viewers have access to some special devices, such as: the left eye and the right eye can be respectively superposed on the retina through the convergence function of the two eyes, and the brain nerves generate a three-dimensional visual effect.
The above description illustrates: whichever implementation is used, the key is that it must be made that the left and right eye of the viewer see no exactly the same image, namely: the picture corresponding to the left eye is observed only by the left eye, and the picture corresponding to the right eye is observed only by the right eye. Thus, a camera with a stereoscopic effect must have two cameras to image and process the images. However, the existing shooting device has some disadvantages, which mainly appear in the following three aspects:
first, the two cameras cannot be identical due to physical properties, such as: focal lengths are not completely the same, so that the two cameras are not completely consistent in focusing performance, and the definition of left and right videos is not completely consistent, and finally image imaging blurring is caused.
Secondly, there is an error in the installation and alignment of the two cameras, which results in that the images shot by the two cameras are not completely consistent in the horizontal and oblique directions of the viewing angles, and further causes deviation in image processing, and finally causes image ghost.
Finally, the difference in electrical performance of the respective image sensors in the two cameras causes the photographed images to be inconsistent in characteristics such as brightness, contrast, chromaticity, gray scale and the like, thereby causing visual difference of the left and right images, and finally causing the phenomena of visual vertigo, image blurring and the like of audiences.
Fig. 1 is an abstract drawing of a chinese patent "a stereo camera device and method" with application number 200910104853.9, which discloses a stereo camera device, which uses a precise optical imaging structure to ensure the consistency on the optical path, and uses only one image sensor to receive two paths of images, however, as seen from fig. 1, the patent has important technical defects, which are mainly shown in the following:
first, the first optical imaging lens group 111 and the second optical imaging lens group 112 are far away from the image sensor 120. When a long shot is shot, the optical imaging lens group is generally required to be closer to the optical path of the image sensor according to the lens imaging rule, otherwise, the image is blurred, so that the device and the method disclosed by the patent cannot shoot the long shot;
secondly, since all the light rays of each light ray emitted by the object can be imaged only after being reflected by the same angle of the plane mirror, the patent does not fully disclose the technical details that the positions of the mirror surfaces of the first plane mirror 114, the second plane mirror 115 and the third plane mirror 113 have a certain relationship, and thus, the imaging on the image sensor 120 may not be performed, and the purpose of shooting cannot be achieved at all.
SUMMERY OF THE UTILITY MODEL
In view of this, the main objective of the present invention is to provide a stereo camera device to solve the defects of the prior art that the optical path is not consistent and the electrical performance is not consistent.
In order to achieve the above purpose, the technical scheme of the utility model is realized like this:
the utility model provides a three-dimensional camera device, include: the camera module comprises a camera module, a first plane reflector, a second plane reflector, a third plane reflector and a fourth plane reflector;
the camera module includes: an optical imaging lens group and an optical sensor;
the mirror surface of the first plane mirror is parallel to the mirror surface of the second plane mirror; the mirror surface of the third plane mirror is parallel to the mirror surface of the fourth plane mirror;
the first plane mirror, the second plane mirror, the third plane mirror, and the fourth plane mirror are disposed in front of the optical imaging lens group; the optical imaging lens group is arranged in front of the optical sensor.
In the above solution, a distance between a center point of the first plane mirror and a center point of the third plane mirror is equal to or similar to a distance between eyes of a human.
In the above solution, the first plane mirror and the third plane mirror are symmetrically disposed with an optical axis of the optical imaging lens group as a symmetry axis; the second plane reflector and the fourth plane reflector are symmetrically arranged by taking the optical axis of the optical imaging lens group as a symmetry axis.
In the above solution, the first plane mirror, the second plane mirror, the third plane mirror and the fourth plane mirror have a rectangular or circular shape.
In the above scheme, the optical imaging lens group is a convex lens.
In the above scheme, the optical sensor is a Charge-coupled device (CCD) image sensor or a Complementary Metal Oxide Semiconductor (CMOS) optical sensor.
The utility model provides a three-dimensional camera device, in the place ahead of camera module, with the optical axis of optics formation of image lens group as the symmetry axis arrangement two pairs of plane reflection mirrors, the light that the object reflects passes through these two pairs of plane reflection mirrors, all focuses on the optics formation of image lens group of camera module to utilize an optical sensor to carry out the conversion of electric signal to the light that feels sensitively, so, can guarantee the uniformity on the formation of image light path, can also guarantee that the electrical property of the image of shooing is completely unanimous; in addition, two groups of plane reflectors are not arranged between the optical imaging lens group and the optical sensor at intervals, and the relative distance is short, so that the optical imaging lens group is also suitable for shooting long-range views.
Drawings
FIG. 1 is a drawing of an abstract of a patent of a stereo camera device and method;
fig. 2 is a top view of the stereo camera device of the present invention;
FIG. 3 is a diagram of the path of light through which reflected light passes according to an embodiment.
Detailed Description
The basic idea of the utility model is that: the device adopts a precise optical imaging structure to ensure the consistency on a light path, two pairs of plane reflectors are arranged in front of the camera, and when the device is used for shooting, light rays reflected by an object pass through the two pairs of plane reflectors and enter the camera; the reflected light of the object is focused on the optical sensor through the optical imaging lens group on the camera, and only one image sensor is used for receiving two paths of images, so that the electrical property of the shot images is ensured to be completely consistent.
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
The utility model provides a top view of three-dimensional camera device, as shown in FIG. 2, include: a camera module 21, a first plane reflector 22, a second plane reflector 23, a third plane reflector 24 and a fourth plane reflector 25; wherein,
the camera module 21 includes: an optical imaging lens group 211, and an optical sensor 212.
The mirror surface of the first plane mirror 22 is parallel to the mirror surface of the second plane mirror 23; a mirror surface of the third plane mirror 24 parallel to a mirror surface of the fourth plane mirror 25;
the distance between the central point of the first plane reflector 22 and the central point of the third plane reflector 24 is equal to or similar to the distance between the eyes of a person, generally, the distance can be 65mm, or the distance can be any value between 65mm plus or minus 10mm, so as to ensure that the eyes of the person can see clear three-dimensional images; the first plane mirror 22 and the third plane mirror 24 are symmetrically arranged in front of the optical imaging lens group 211 with the optical axis of the optical imaging lens group 211 as a symmetry axis; the second plane mirror 23 and the fourth plane mirror 25 are symmetrically arranged in front of the optical imaging lens group 211 by taking the optical axis of the optical imaging lens group 211 as a symmetry axis;
the optical imaging lens group 211 is arranged in front of the optical sensor 212;
the foregoing means that after the stereo camera is laid flat, the components of the stereo camera viewed from the direction of the optical sensor 212 sequentially include: the optical imaging lens group 211 is disposed in front of the optical sensor 212, the first plane mirror 22, the second plane mirror 23, the third plane mirror 24, and the fourth plane mirror 25 are disposed in front of the optical imaging lens group 211, and further, the second plane mirror 23 and the fourth plane mirror 25 may be disposed in front of the first plane mirror 22 and the third plane mirror 24;
the distance between the second plane mirror 23 and the fourth plane mirror 25 can be set arbitrarily within a range of distances that can reflect light rays.
The first plane mirror 22, the second plane mirror 23, the third plane mirror 24, and the fourth plane mirror 25 may have a rectangular shape or a circular shape.
The first plane reflector 22 reflects the light emitted from the object for one time, and the reflected light irradiates the second plane reflector 23; the second plane reflector 23 reflects the light reflected by the first plane reflector 22 for the second time, and the reflected light irradiates the optical imaging lens group 211 in the camera module 21;
the optical imaging lens group 211 in the camera module 21 focuses the light reflected by the second plane mirror 23, and the focused light irradiates the optical sensor 212 in the camera module 21;
the third plane mirror 24 reflects the light emitted from the object for one time, and the reflected light irradiates the fourth plane mirror 25; the fourth plane reflector 25 reflects the light reflected by the third plane reflector 24 for the second time, and the reflected light irradiates the optical imaging lens group 211 in the camera module 21;
the optical imaging lens group 211 in the camera module 21 focuses the light reflected by the fourth plane mirror 25, and the focused light irradiates the optical sensor 212 in the camera module 11;
the optical sensor 212 converts the sensed light focused by the optical imaging lens group 211 in the camera module 21 into an electrical signal.
The optical imaging lens group 211 may be a convex lens; the optical sensor 212 may be a CCD image sensor or a CMOS optical sensor.
The present invention will be described in further detail with reference to the following examples.
Fig. 3 is for using the utility model provides a when stereo camera device shoots the object, the light path picture that reflection light passes through, as shown in fig. 3, the hypothesis utilizes the utility model provides an object 30 that stereo camera device shot launches two bundles of light, promptly: ray 31 and ray 41.
The first plane reflector 22 reflects the light 31 emitted from the object 30 to be shot once, and the reflected light 32 irradiates the second plane reflector 23; the second plane reflector 23 reflects the light 32 reflected by the first plane reflector 22 for the second time, and the reflected light 33 irradiates the optical imaging lens group 211 in the camera module 21;
the optical imaging lens group 211 focuses the light 33 reflected by the second plane mirror 23, and the focused light 34 irradiates the optical sensor 212 in the camera module 21;
the third plane mirror 24 reflects the light 41 emitted from the object 30 once, and the reflected light 42 is irradiated to the fourth plane mirror 25; the fourth plane mirror 25 reflects the light 42 reflected by the third plane mirror 24 for the second time, and the reflected light 43 irradiates the optical imaging lens group 211 in the camera module 21;
the optical imaging lens group 211 focuses the light 43 reflected by the second plane mirror 23, and the focused light 44 irradiates the optical sensor 212 in the camera module 21;
the optical sensor 212 converts the sensed light 34 and 44 focused by the optical imaging lens group 211 in the camera module 21 into electrical signals.
Thus, the camera module 21 can obtain two images with parallax, and the electrical performance of the two images is completely consistent.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and should not be taken as limiting the scope of the present invention, and any modifications, equivalent replacements, and improvements made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (6)
1. A stereoscopic camera apparatus, comprising: the camera module comprises a camera module, a first plane reflector, a second plane reflector, a third plane reflector and a fourth plane reflector;
the camera module includes: an optical imaging lens group and an optical sensor;
the mirror surface of the first plane mirror is parallel to the mirror surface of the second plane mirror; the mirror surface of the third plane mirror is parallel to the mirror surface of the fourth plane mirror;
the first plane mirror, the second plane mirror, the third plane mirror, and the fourth plane mirror are disposed in front of the optical imaging lens group; the optical imaging lens group is arranged in front of the optical sensor.
2. The apparatus of claim 1,
the distance between the central point of the first plane reflector and the central point of the third plane reflector is equal to or approximate to the distance between the eyes of the human body.
3. The device according to claim 1 or 2,
the first plane reflector and the third plane reflector are symmetrically arranged by taking the optical axis of the optical imaging lens group as a symmetry axis; the second plane reflector and the fourth plane reflector are symmetrically arranged by taking the optical axis of the optical imaging lens group as a symmetry axis.
4. The apparatus of claim 1 or 2, wherein the first, second, third and fourth planar mirrors have a rectangular or circular shape.
5. The apparatus according to claim 1 or 2, wherein said optical imaging lens group is a convex lens.
6. The device of claim 1 or 2, wherein the optical sensor is a charge-coupled device (CCD) image sensor or a complementary metal-oxide semiconductor (CMOS) optical sensor.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010201732574U CN201662682U (en) | 2010-04-27 | 2010-04-27 | Stereo pick-up device |
| PCT/CN2010/075841 WO2011134215A1 (en) | 2010-04-27 | 2010-08-10 | Stereoscopic camera device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010201732574U CN201662682U (en) | 2010-04-27 | 2010-04-27 | Stereo pick-up device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN201662682U true CN201662682U (en) | 2010-12-01 |
Family
ID=43233100
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010201732574U Expired - Fee Related CN201662682U (en) | 2010-04-27 | 2010-04-27 | Stereo pick-up device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN201662682U (en) |
| WO (1) | WO2011134215A1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102736367A (en) * | 2011-03-29 | 2012-10-17 | 索尼公司 | Two-lens device and stereoscopic imaging apparatus with two-lens device |
| CN105892216A (en) * | 2015-12-14 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | 3D video recording device, 3D video processing method and mobile equipment |
| WO2017193891A1 (en) * | 2016-05-09 | 2017-11-16 | 丰唐物联技术（深圳）有限公司 | Lens and shooting apparatus |
| CN107390348A (en) * | 2016-05-17 | 2017-11-24 | 杭州海康机器人技术有限公司 | Optical imaging device and video camera |
| CN107490842A (en) * | 2017-09-26 | 2017-12-19 | 北京地平线信息技术有限公司 | Camera module, imaging device and image processing method |
| CN108759685A (en) * | 2018-06-16 | 2018-11-06 | 慧眼自动化科技（广州）有限公司 | A kind of mechanism for sweeping camera heights measurement based on line |
| CN109829927A (en) * | 2019-01-31 | 2019-05-31 | 深圳职业技术学院 | A kind of electronic glasses and high-altitude scene image method for reconstructing |
| CN110286385A (en) * | 2019-07-02 | 2019-09-27 | 苏州全视智能光电有限公司 | A binocular stereo structured light sensing device |
| CN113566986A (en) * | 2021-07-27 | 2021-10-29 | 浙江大学 | Method and device for synchronously testing strain field and temperature field of non-contact solid surface |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002027496A (en) * | 2000-07-03 | 2002-01-25 | Canon Inc | Imaging lens unit, imaging device, and imaging system |
| US7791640B2 (en) * | 2004-01-23 | 2010-09-07 | Olympus Corporation | Electronic camera and image generating apparatus generating stereo image |
| JP2007264504A (en) * | 2006-03-29 | 2007-10-11 | Fujitsu Ltd | Imaging apparatus and imaging method |
| CN101482693A (en) * | 2008-12-01 | 2009-07-15 | 深圳市掌网立体时代视讯技术有限公司 | Single-sensor paralleling type stereoscopic picture shooting method and device |
| CN201298140Y (en) * | 2008-12-04 | 2009-08-26 | 胡超 | A single lens stereo image optical signal acquisition device |
-
2010
- 2010-04-27 CN CN2010201732574U patent/CN201662682U/en not_active Expired - Fee Related
- 2010-08-10 WO PCT/CN2010/075841 patent/WO2011134215A1/en active Application Filing
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102736367A (en) * | 2011-03-29 | 2012-10-17 | 索尼公司 | Two-lens device and stereoscopic imaging apparatus with two-lens device |
| CN105892216A (en) * | 2015-12-14 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | 3D video recording device, 3D video processing method and mobile equipment |
| WO2017193891A1 (en) * | 2016-05-09 | 2017-11-16 | 丰唐物联技术（深圳）有限公司 | Lens and shooting apparatus |
| CN107390348A (en) * | 2016-05-17 | 2017-11-24 | 杭州海康机器人技术有限公司 | Optical imaging device and video camera |
| CN107390348B (en) * | 2016-05-17 | 2023-12-29 | 杭州海康机器人股份有限公司 | Optical imaging device and camera |
| CN107490842A (en) * | 2017-09-26 | 2017-12-19 | 北京地平线信息技术有限公司 | Camera module, imaging device and image processing method |
| CN107490842B (en) * | 2017-09-26 | 2024-03-05 | 北京地平线信息技术有限公司 | Image pickup module, imaging apparatus, and image processing method |
| CN108759685A (en) * | 2018-06-16 | 2018-11-06 | 慧眼自动化科技（广州）有限公司 | A kind of mechanism for sweeping camera heights measurement based on line |
| CN108759685B (en) * | 2018-06-16 | 2023-05-30 | 慧眼自动化科技（广州）有限公司 | Mechanism based on line sweeps camera height measurement |
| CN109829927A (en) * | 2019-01-31 | 2019-05-31 | 深圳职业技术学院 | A kind of electronic glasses and high-altitude scene image method for reconstructing |
| CN110286385A (en) * | 2019-07-02 | 2019-09-27 | 苏州全视智能光电有限公司 | A binocular stereo structured light sensing device |
| CN113566986A (en) * | 2021-07-27 | 2021-10-29 | 浙江大学 | Method and device for synchronously testing strain field and temperature field of non-contact solid surface |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2011134215A1 (en) | 2011-11-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN201662682U (en) | Stereo pick-up device | |
| Okano et al. | Real-time integral imaging based on extremely high resolution video system | |
| US10715711B2 (en) | Adaptive three-dimensional imaging system and methods and uses thereof | |
| CN101937168B (en) | Optical stereo imaging device and stereo camera method | |
| TW201012202A (en) | Solid-state panoramic image capture apparatus | |
| JP2010113720A (en) | Method and apparatus for combining range information with optical image | |
| US9019603B2 (en) | Two-parallel-channel reflector with focal length and disparity control | |
| JP6419110B2 (en) | Array lens module | |
| CN101916035A (en) | Stereo pick-up device and method | |
| KR102031485B1 (en) | Multi-view capturing apparatus and method using single 360-degree camera and planar mirrors | |
| CN103235479B (en) | 3D camera lens | |
| CN104834102B (en) | Optical system capable of changing single camera into stereo camera and method thereof | |
| AU2013308155B2 (en) | Method for description of object points of the object space and connection for its implementation | |
| CN105137606B (en) | Stereo vision imaging apparatus and method based on DMD | |
| CN108121078A (en) | A kind of camera lens for the view for shooting multiple visual angles | |
| CN205160708U (en) | Stereovision camera | |
| WO2020244273A1 (en) | Dual camera three-dimensional stereoscopic imaging system and processing method | |
| CN103412461B (en) | 3D imaging system based on light splitting piece | |
| CN110708532A (en) | Universal light field unit image generation method and system | |
| WO2024051214A1 (en) | Three-dimensional image collection apparatus and method, and related device | |
| US8912483B2 (en) | Display measuring device | |
| Montgomery et al. | Stereoscopic camera design | |
| Koyama et al. | A 3D vision 2.1 Mpixel image sensor for single-lens camera systems | |
| CN105263016A (en) | Stereo optical system and imaging method thereof | |
| KR101790168B1 (en) | Three-dimensional display apparatus using a parabolic mirror |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101201 Termination date: 20170427 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |