CN114885079B - Chip control method, control terminal device and computer readable storage medium - Google Patents
Chip control method, control terminal device and computer readable storage mediumInfo
- Publication number
- CN114885079B CN114885079B CN202210454027.2A CN202210454027A CN114885079B CN 114885079 B CN114885079 B CN 114885079B CN 202210454027 A CN202210454027 A CN 202210454027A CN 114885079 B CN114885079 B CN 114885079B
- Authority
- CN
- China
- Prior art keywords
- offset data
- image sensing
- chip
- optimal correction
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/684—Vibration or motion blur correction performed by controlling the image sensor readout, e.g. by controlling the integration time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a chip control method, control terminal equipment and a computer readable storage medium, wherein the method is applied to the control terminal equipment, the control terminal equipment comprises a processor, a memory and a plurality of image sensing chips, each image sensing chip is internally provided with an MEMS gyroscope, the memory is provided with a database for storing optimal correction parameters corresponding to offset data of the MEMS gyroscope, the method comprises the steps of receiving the offset data of each MEMS gyroscope, comparing the offset data with the database to obtain the corresponding optimal correction parameters, and correcting the movement of the image sensing chip according to the optimal correction parameters. The chip control method provided by the invention can correct the movement of the image sensing chips, can realize the connection of the association points among a plurality of adjacent image sensing chips, improves the anti-interference capability of equipment and improves the image quality.
Description
Technical Field
The present invention relates to the field of image acquisition and processing technologies, and in particular, to a chip control method, a control terminal device, and a computer readable storage medium.
Background
With the updating of electronic products, the image capturing function is also becoming popular in various electronic products, which enables users to capture images in various scenes. In the image capturing apparatus in the related art, a plurality of image sensing chips are generally provided, association points are provided between the image sensing chips, each image sensing chip is responsible for capturing different areas, and capturing results of all the image sensing chips are integrated to obtain a final image.
However, these image capturing apparatuses in the related art can complete the integration processing of images only in the case of fixed-point capturing, and in the case of mobile capturing, images captured due to lens shake or the like cannot hold the associated points, and capturing cannot be completed well.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
In order to solve the problem of image quality degradation caused by equipment shake during shooting in the related art, the embodiment of the invention provides a chip control method, a control terminal device and a computer readable storage medium, which can properly control the moving tracks of a plurality of image sensing chips, thereby ensuring the image quality of panoramic shooting and improving the anti-interference capability of the shooting.
In a first aspect, an embodiment of the present invention provides a chip control method, applied to a control terminal device, where the control terminal device includes a processor, a memory, and a plurality of image sensing chips, each of which is built in a MEMS gyroscope, and the memory is provided with a database storing an optimal correction parameter corresponding to offset data of the MEMS gyroscope (Micro Electro MECHANICAL SYSTEMS, micro Electro mechanical system), where the method includes:
Receiving said offset data for each of said MEMS gyroscopes;
comparing the offset data with the database to obtain the corresponding optimal correction parameters;
And correcting the movement of the image sensing chip according to the optimal correction parameters.
In some embodiments, the comparing the offset data with the database to obtain the corresponding optimal correction parameter, specifically, comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameter.
In some embodiments, the comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameter includes:
Setting any one of the image sensing chips as a reference chip;
determining the offset data of other image sensing chips according to the offset data of the reference chip;
And comparing the offset data of the other image sensing chips with the database to obtain the optimal correction parameters of the other image sensing chips.
In some embodiments, the comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameter includes:
Presetting reference parameters, wherein the reference parameters comprise a reference axis point and a reference angle;
Determining the offset data of the image sensing chip according to the reference parameters;
and comparing the offset data with the database to obtain the optimal correction parameters.
In some embodiments, the control terminal device further includes a tachometer, and the processor is provided with a register, and after comparing the offset data with the database to obtain the corresponding optimal correction parameter, the method further includes:
Acquiring the real-time speed of the image sensing chip;
Caching the offset data and the real-time speed into the register;
caching the optimal correction parameters corresponding to the offset data into the register;
Determining that the number of occurrences of the offset data and the real-time speed cached in the register reaches a preset threshold;
and calling the optimal correction parameters corresponding to the offset data in the register.
In some embodiments, a voltmeter is disposed in the MEMS gyroscopes, and before said receiving the offset data for each of the MEMS gyroscopes, further comprising:
Obtaining input voltage measured by the MEMS gyroscope, wherein the input voltage carries the offset data;
And determining that the input voltage is different from a preset voltage.
In some embodiments, the method further comprises:
obtaining photographic parameters of each image sensing chip;
and correcting the photographing parameters of the image sensing chip according to the preset comparison standard.
In a second aspect, an embodiment of the present invention provides a control terminal device, including:
A plurality of the image sensing chips are arranged, each image sensing chip is internally provided with an MEMS gyroscope;
The memory is provided with a database for storing the optimal correction parameters corresponding to the offset data of the MEMS gyroscope;
the processor is used for receiving the offset data of the image sensing chip measured by the MEMS gyroscope, comparing the offset data with the database and correcting the image sensing chip according to the corresponding optimal correction parameters.
In some embodiments, the control terminal device further includes a tachometer, and the processor is further provided with a register, where the tachometer is configured to detect a real-time speed of each of the image sensor chips, and the register is configured to buffer the real-time speed, the offset data, and the corresponding optimal correction parameters.
In a third aspect, an embodiment of the present invention provides a computer-readable storage medium storing a computer program, which when executed by a processor, implements a chip control method as in the first aspect.
The embodiment of the invention comprises the step of arranging a processor, a memory and a plurality of image sensing chips in the control terminal equipment. Each image sensing chip is internally provided with an MEMS gyroscope, a database is arranged in the memory, and the database is pre-stored with the optimal correction parameters corresponding to the offset data of the MEMS gyroscope. When a user shoots, the MEMS gyroscope measures offset data of the image sensing chip caused by shaking and the like, and sends the offset data to the processor. The processor compares the received offset data with the data in the database, so that the optimal correction parameters corresponding to each image sensing chip are obtained, and the moving track of the image sensing chip is corrected according to the optimal correction parameters, so that shooting is ensured to be kept stable. The chip control method provided by the invention can correct the movement of the image sensing chips, ensure the stability of the association points among a plurality of adjacent image sensing chips, improve the anti-interference capability of equipment and improve the image quality.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate and do not limit the invention.
FIG. 1 is a flow chart of a chip control method provided by an embodiment of the present invention;
FIG. 2 is a flow chart of setting a reference chip provided by an embodiment of the present invention;
FIG. 3 is a flow chart of setting reference parameters provided by an embodiment of the present invention;
FIG. 4 is a flow chart of periodic data feedback provided by an embodiment of the present invention;
FIG. 5 is a flow chart of a comparison voltage provided by an embodiment of the present invention;
FIG. 6 is a flowchart of a photographic parameter correction provided by an embodiment of the present invention;
Fig. 7 is a block diagram of a control terminal device according to an embodiment of the present invention;
Fig. 8 is another block diagram of a control terminal device according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
It should be noted that although functional block division is performed in a block diagram and logical order is shown in a flowchart, in some cases, steps shown or described may be performed in a different order than block division in a block, or order in a flowchart. The terms first, second and the like in the description and in the claims and in the above-described figures, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The invention provides a chip control method, which is applied to control terminal equipment, the control terminal device comprises a processor, a memory and a plurality of image sensing chips. Each image sensing chip is internally provided with a MEMS (Micro Electro MECHANICAL SYSTEMS, micro Electro mechanical system) gyroscope, a database is arranged in the memory, and the database is pre-stored with the optimal correction parameters corresponding to the offset data of the MEMS gyroscope. When a user shoots, the processor receives offset data, which is measured by the MEMS gyroscope and is caused by shaking and the like, of the image sensing chip. The processor compares the received offset data with the data in the database, so that the optimal correction parameters corresponding to each image sensing chip are obtained, and the moving track of the image sensing chip is corrected according to the optimal correction parameters, so that shooting is ensured to be kept stable. The chip control method provided by the invention can correct the movement of the image sensing chips, can realize the connection of the association points among a plurality of adjacent image sensing chips, improves the anti-interference capability of equipment and improves the image quality. The chip control method and the control terminal device described in the embodiments of the present invention are for more clearly describing the technical solution of the embodiments of the present invention, and do not constitute a limitation on the technical solution provided by the embodiments of the present invention, and those skilled in the art can know that, with the evolution of the image acquisition processing technology and the appearance of a new application scenario, the technical solution provided by the embodiments of the present invention is also applicable to similar technical problems.
As shown in fig. 1, fig. 1 is a flowchart of a chip control method according to an embodiment of the present invention. It can be appreciated that the invention provides a chip control method applied to control terminal equipment. The control terminal equipment comprises a processor, a memory and a plurality of image sensing chips, wherein each image sensing chip is internally provided with an MEMS gyroscope, a database is arranged in the memory, and the database is pre-stored with optimal correction parameters corresponding to offset data of the MEMS gyroscope. The method includes, but is not limited to, step S100, step S200, and step S300.
Step S100, receiving offset data of each MEMS gyroscope.
It will be appreciated that in the terminal device, a plurality of image sensing chips are typically provided, each image sensing chip is responsible for capturing a corresponding area, and a correlation point is provided between a plurality of adjacent image sensing chips, that is, the contents captured by the plurality of adjacent image sensing chips have an intersection. After each image sensing chip shoots, all the images shot by the image sensing chips are combined through the associated points, and then a panoramic image can be obtained. However, when the user photographs, the image sensing chip may shake due to external factors, so that the corresponding association points cannot be kept in contact. Therefore, the MEMS gyroscope is arranged in the image sensing chip, and the offset data of the image sensing chip can be detected through the MEMS gyroscope, so that whether the image sensing chip is offset or not can be judged. The MEMS gyroscope used in the invention has the advantages of higher reaction speed than other gyroscopes, capability of better completing information synchronization, small volume occupation, light weight and being packaged on the same circuit board together with the image sensing chip. And the MEMS gyroscope has the advantages of large measurable range, good reliability, long service life and capability of bearing larger impact, and is very suitable for the use scene provided by the invention.
Furthermore, the MEMS gyroscope can be packaged on the same substrate with the image sensing chip, compared with the existing method of packaging on the same circuit board, the MEMS gyroscope has faster response speed in data transmission than the MEMS gyroscope packaged on the same circuit board, can transmit information faster, and can acquire the offset data of the MEMS gyroscope and the image of the image sensing chip simultaneously when the image sensing chip generates offset.
It should be noted that the offset data includes, but is not limited to, an axis point and an angle of the image sensor chip that are offset when moving. According to the offset data of the image sensing chip, the current offset condition of the image sensing chip can be known, and adjustment is correspondingly made.
And step S200, comparing the offset data with a database to obtain the corresponding optimal correction parameters.
It can be understood that a database is provided in the memory, and offset data and corresponding optimal correction parameters that may occur to the image sensing chip are pre-stored in the database. After receiving the offset data of the MEMS gyroscope, the processor compares the offset data with the data in the database, so as to obtain the optimal correction parameters corresponding to the current image sensing chip.
It should be noted that, in the database provided in the memory according to the present invention, offset data and corresponding optimal correction parameters are stored. In the chip control method provided by the invention, the plurality of MEMS gyroscopes are required to be continuously simulated and trained in advance by the processor, the offset data measured by the MEMS gyroscopes are processed and operated by the processor, and the obtained optimal operation result is stored in the database. The method comprises the steps of training a model of a plurality of MEMS gyroscopes, so that data transmission of the MEMS gyroscopes is realized in the process of actually shooting images, and meanwhile, a processor obtains an operation result according to a model trained in advance in a memory, namely, corresponding optimal correction parameters are obtained, so that the correlation points among image sensing chips are maintained.
Step S300, correcting the movement of the image sensing chip according to the optimal correction parameters.
It can be understood that after obtaining the optimal correction parameters corresponding to each image sensor chip, the processor corrects the movement track of each image sensor chip according to the optimal correction parameters, so that the association points between a plurality of adjacent image sensor chips return to the corresponding states, and finally, the panoramic image can be combined according to the association points. According to the invention, the offset parameters of the image sensing chip are obtained and compared in the database to obtain the corresponding optimal correction parameters, and the offset track of the image sensing chip is corrected according to the optimal correction parameters, so that the anti-interference capability of shooting is improved, the imaging quality is improved, and the efficiency and reliability of image acquisition in the shooting of panoramic images are improved.
It should be noted that the control terminal device provided in the present invention includes a plurality of image sensing chips, and the plurality of image sensing chips are symmetrically distributed. That is, in the set photographing region, the image sensing chips are required to be set so that the correlation points between a plurality of adjacent image sensing chips are maintained, and each image sensing chip has a corresponding image sensing chip, thereby ensuring the panorama of image acquisition.
It can be understood that in step S200, in the process of comparing the offset data with the database to obtain the corresponding optimal correction parameters, specifically, comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameters. In the actual use process of a user, a reference can be preset according to actual demands, the reference is unchanged, and the moving track of the image sensing chip is corrected according to the preset comparison reference, so that image acquisition is realized.
As shown in fig. 2, fig. 2 is a flowchart of setting a reference chip according to an embodiment of the present invention. It can be understood that the chip control method provided by the present invention further includes, but is not limited to, step S410, step S420, and step S430.
In step S410, any one of the image sensor chips is set as a reference chip.
Step S420, determining offset data of other image sensing chips according to the offset data of the reference chip.
And step S430, comparing the offset data of the other image sensing chips with the database to obtain the optimal correction parameters of the other image sensing chips.
It will be appreciated that in step S410, an image sensing chip may be selected as a reference chip, the reference chip is only passively displaced due to lens shake, and the processor does not actively adjust the movement track of the reference chip. After the reference chip is set, step S420 is executed, the reference chip is still, and other image sensing chips can also keep the original axial point and angle, or the reference chip is passively moved, according to the offset data of all the image sensing chips, the offset data of the other image sensing chips relative to the reference chip can be obtained, that is, the axial point offset degree and offset angle of the other image sensing chips relative to the reference chip are obtained. And comparing the offset data in a database to obtain the optimal correction parameters of other image sensing chips, finally executing step S430, correcting the moving track by the other image sensing chips according to the respective optimal correction parameters, adjusting the moving axis point, and adjusting the angle according to the axis point, so that the correlation point between the other image sensing chips and the reference chip can be kept unchanged continuously.
It will be appreciated that in selecting the reference chip, a reference chip is typically selected that is located at a middle position of the plurality of image sensing chips. When the offset data of other image sensing chips are determined according to the reference chip, the offset data can be quickly determined because the other image sensing chips are arranged around the reference chip, so that the moving track of the image sensing chip is corrected, and the anti-interference performance of the device is improved.
As shown in fig. 3, fig. 3 is a flowchart of setting a reference parameter according to an embodiment of the present invention. It can be understood that the chip control method provided by the present invention further includes, but is not limited to, step S510, step S520 and step S530.
In step S510, reference parameters are preset, where the reference parameters include a reference axis point and a reference angle.
Step S520, determining offset data of the image sensor chip according to the reference parameter.
In step S530, the offset data is compared with the database to obtain the optimal correction parameters.
It is understood that in step S510, a specific axis point and angle may be selected as a reference, that is, a reference axis point and a reference angle may be set, and a preset axis point and angle may be used as reference parameters. Because there are correlation points between the image sensing chips, when any image sensing chip moves and shifts from the reference axis point to the reference angle, the angle of the image sensing chip changes. When one or more image sensor chips deviate from a preset axis point or a preset angle, the image sensor chip with deviation sends its own deviation data to the processor, and the processor executes step S520 to determine the deviation data of the image sensor chips according to the reference axis point and the reference angle, that is, determine the deviation degree of each image sensor chip relative to the reference axis point and the reference angle, where the axis point and the angle deviate. Then, the processor performs step S530 to compare the received offset data with the data in the database, thereby determining the corresponding optimal correction parameters, and sends the optimal correction parameters to the corresponding image sensor chips, so as to adjust the axis points and angles of the offset image sensor chips, that is, adjust the moving track thereof, so as to make the moving track return to the specific image area, and keep the stability of the association points between the adjacent image sensor chips, thereby improving the panoramic image imaging quality.
It should be noted that, the preset reference provided in the present invention may be that a certain image sensing chip is used as a reference chip to adjust the moving track of other image sensing chips, or a certain specific axis point and angle are used as a reference to adjust all the image sensing chips. Other comparison references can be set, and the correction of the moving track of the image sensing chip with the offset is only required, so that the stability of the association points among a plurality of adjacent image sensing chips is ensured, and the invention is not particularly limited to the above.
As shown in fig. 4, fig. 4 is a flowchart of periodic data feedback provided by an embodiment of the present invention. It can be understood that the control terminal device provided by the invention further comprises a velocimeter, and a register is arranged in the processor. After comparing the offset data with the database according to the preset comparison standard to obtain the corresponding optimal correction parameters, the method further includes, but is not limited to, step S610, step S620, step S630, step S640 and step S650.
In step S610, the real-time speed of the image sensor chip is obtained.
In step S620, the offset data and the real-time speed are cached in the register.
In step S630, the best correction parameters corresponding to the offset data are cached in the register.
In step S640, it is determined that the number of repetitions of the offset data and the real-time speed buffered in the register reaches the preset threshold.
In step S650, the register is called with the best correction parameter corresponding to the offset data.
It will be appreciated that the velocimeter proposed in this embodiment is used to detect the current real-time speed of each image sensor chip, and the register is used to buffer the data input by the MEMS gyroscope. Firstly, step S610 is executed, the real-time speed of the image sensor chip is measured by the velocimeter, and then, in step S620, the offset data and the real-time speed of the image sensor chip are buffered in the register. At this time, after the processor compares the data base and obtains the optimal correction parameters, step S630 is executed to buffer the optimal correction parameters corresponding to the offset data into the register. When the MEMS gyroscope in the image sensor chip reciprocates, the offset data buffered to the register, the real-time speed and the optimal correction parameters are also periodically repeated. The image sensing chips move until step S640 is executed, it is determined that the number of periodical repetitions of the offset data and the real-time speed buffered in the register reaches a preset threshold, that is, the current movement of each image sensing chip is periodical reciprocating movement, and the axis point, the angle and the real-time speed of each frame movement of each image sensing chip are all kept unchanged. When the periodical repetition times reach the preset threshold, the processor can directly grasp the corresponding optimal correction parameters in the register in the following data processing, so that the image sensing chip is directly adjusted. When it is determined that the offset data cached in the register and the occurrence cycle repetition times of the real-time speed reach the preset threshold, the processor can directly compare and call the corresponding optimal correction parameters in the register in the processor when receiving the new offset data, and the processor does not need to compare and call the data from the database of the memory, so that the operation speed of the device is improved.
It should be noted that, the processor is further provided with a trigger module, where the trigger module is configured to determine whether the number of repetitions of the offset data and the real-time speed buffered in the register has reached a preset threshold. When the trigger module is activated, the processor does not need to compare from the database of the memory, but can directly grasp the remaining optimal correction parameters in the period from the register and send the optimal correction parameters to the corresponding image sensing chip, so as to adjust the moving track of the image sensing chip.
It should be noted that when the MEMS gyroscope stops inputting the periodic offset data, the corresponding data is not cached in the register, so that the processor cannot successfully compare in the register, and the processor compares again from the database of the memory, and completes the call of the optimal correction parameters.
It should be noted that, the preset threshold value provided by the present invention refers to a value of the number of times set by the user according to the actual requirement, which may be two times, three times or more, and after the repetition number of data transmission reaches the preset threshold value, the trigger module is activated, and the processor directly performs comparison and call of data in the register. The invention is not particularly limited to the magnitude of the preset threshold.
As shown in fig. 5, fig. 5 is a flowchart of comparing voltages according to an embodiment of the present invention. It will be appreciated that the control terminal device of the present invention further includes a voltmeter, and further includes, but is not limited to, step S710 and step S720 before step S100 of fig. 1.
In step S710, an input voltage measured by the MEMS gyroscope is obtained, where the input voltage carries offset data.
In step S720, it is determined that the input voltage is different from the preset voltage.
It will be appreciated that a voltmeter is provided in the MEMS gyroscope for detecting the current input voltage and comparing the input voltage with a preset voltage. Because the input voltage carries offset data of the MEMS gyroscope, namely the input voltage carries information such as an axis point, an angle and the like of the MEMS gyroscope, the input voltage is compared with the preset voltage according to preset voltage set by the information such as the axis point, the angle and the like when the MEMS gyroscope is not offset, if the input voltage is the same as the preset voltage, the image sensing chip is not moved when the frame is shot, the MEMS gyroscope does not need to send the data such as the axis point, the angle and the like corresponding to the frame to the processor, and when the input voltage is different from the preset voltage, the image sensing chip is offset when the frame is shot, so that the MEMS gyroscope needs to send the offset data of the frame to the processor, and the processor is convenient for correcting the moving track of the image sensing chip. The arrangement of the voltmeter enables preliminary judgment to be made on whether the image sensing chip is offset or not in the MEMS gyroscope in advance, and when the offset is determined, offset data are sent to the processor for correction, so that the efficiency of processing the data by the device is improved.
As shown in fig. 6, fig. 6 is a flowchart of the photographic parameter correction according to the embodiment of the invention. It can be understood that the chip control method provided by the present invention further includes, but is not limited to, step S810 and step S820.
In step S810, the photographing parameters of each image sensor chip are obtained.
Step S820, correcting the photographing parameters of the image sensor chip according to the preset comparison standard.
It will be appreciated that in the process of capturing an image, since a plurality of images captured by a plurality of image sensor chips need to be combined, offset data, overlapping of associated points, and color problems of the images need to be corrected to further derive the image. Specifically, the offset data correction can be adjusted according to the corresponding optimal correction parameters, the problem of overlapping of the associated points can be solved by fusing the overlapped images in the associated points, and a plurality of images are joined by taking the associated points as the reference among a plurality of image sensing chips, and after redundant image parts are removed, a new image is formed by combining. The correction of the color problem is performed first in step S810 to obtain the photographing parameters of each image sensor chip, and then the adjustment is performed by the preset comparison standard. For example, when a certain image sensing chip is selected as a reference chip, the processor takes an image taken by the reference chip as a reference, and performs replacement processing on color data of other image sensing chips in accordance therewith. When a certain axis point and an angle are selected as the reference, the image sensor chip closest to the reference axis point and the reference parameter is used as the reference chip. Specifically, the photographing parameters proposed by the present invention include, but are not limited to, aperture coefficient, sensitivity, and exposure compensation. After finishing the correction of the photographing parameters, combining the images shot by all the image sensing chips to obtain a panoramic image.
As shown in fig. 7, fig. 7 is a block diagram of a control terminal device according to an embodiment of the present invention. It is to be understood that the second aspect of the present invention proposes a control terminal device 100, where the control terminal device 100 includes a memory 120, a processor 110, and a plurality of image sensing chips 130. The image sensor comprises an image sensor chip 130, a memory 120, a processor 110 and a database, wherein each image sensor chip 130 is provided with a MEMS gyroscope 131, the MEMS gyroscope 131 can detect offset data of the image sensor chip 130, the memory 120 is provided with a database for storing optimal correction parameters corresponding to the offset data of the MEMS gyroscope 131, and the processor 110 is used for receiving the offset data of the image sensor chip 130 measured by the MEMS gyroscope 131, comparing the offset data with the database and correcting the image sensor chip 130 according to the corresponding optimal correction parameters. When a user performs photographing, the MEMS gyroscope 131 measures offset data of the image sensing chip 130 due to shaking or the like, and transmits the offset data to the processor 110. The processor 110 compares the received offset data with the data in the database, so as to obtain the optimal correction parameters corresponding to each image sensor chip 130, and corrects the moving track of the image sensor chip 130 according to the optimal correction parameters, thereby ensuring that the shooting remains stable. The chip control method provided by the invention can correct the movement of the image sensing chips 130, thereby ensuring the stability of the association points among a plurality of adjacent image sensing chips 130, improving the anti-interference capability of equipment and improving the image quality.
As shown in fig. 8, fig. 8 is another block diagram of a control terminal device according to an embodiment of the present invention. It will be appreciated that a tachometer is also included in the control terminal device 100 and a register 111 is also provided in the processor 110. The velocimeter is used for detecting the real-time speed of the first image sensor chip 132 and the second image sensor chip 134, and the register 111 is used for buffering the real-time speed, the offset data and the corresponding optimal correction parameters. In actual photographing, the real-time speeds of the first image sensor chip 132 and the second image sensor chip 134 are measured by a velocimeter, and then the offset data and the real-time speeds of the first image sensor chip 132 and the second image sensor chip 134 are buffered in the register 111. At this time, the processor 110 obtains the optimum correction parameters from the database 121, and then buffers the optimum correction parameters into the register 111. Periodic repetition of offset data, real-time speed, and optimal correction parameters buffered in register 111 also occurs when first MEMS gyroscope 133 in first image sensing chip 132 and second MEMS gyroscope 135 in second image sensing chip 134 are reciprocated. The first image sensor chip 132 and the second image sensor chip 134 move, and at this time, the processor 110 determines that the number of repetitions of the offset data and the real-time speed buffered in the register 111 reaches a preset threshold, that is, the current movement of each image sensor chip 130 is a periodic reciprocal movement, and the axis, the angle, and the real-time speed of each movement of the first image sensor chip 132 and the second image sensor chip 134 remain unchanged. When the number of periodical repetitions reaches the preset threshold, the processor 110 directly captures the corresponding optimal correction parameters in the register 111 according to the received offset data, so as to directly adjust the movement tracks of the first image sensor chip 132 and the second image sensor chip 134, thereby ensuring that the association points between the first image sensor chip 132 and the second image sensor chip 134 remain stable. When it is determined that the number of repetitions of the occurrence of the offset data and the real-time speed buffered in the register reaches the preset threshold, the processor 110 can directly perform comparison in the register in the processor 110 and call the corresponding optimal correction parameter when receiving the new offset data, without performing comparison and calling the data from the database in the memory 120, thereby improving the operation speed of the device.
It should be noted that, in the above embodiment, the first image sensor chip 132 and the second image sensor chip 134 are selected as examples, and the workflow of the control terminal device according to the present invention is appropriately described, which does not represent that only two image sensor chips exist in the embodiment of the present invention. The number of image sensing chips provided in the control terminal device is not particularly limited in the present invention.
The memory 120 serves as a non-transitory computer readable storage medium storing a non-transitory software program and a non-transitory computer executable program, such as the chip control method in the above-described embodiment of the present invention. The processor 110 implements the chip control method in the above-described embodiment of the present invention by running a non-transitory software program and instructions stored in the memory 120.
The memory may include a storage program area that may store an operating system, an application program required for at least one function, and a storage data area that may store data required for performing the chip control method in the above-described embodiment, and the like. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. It should be noted that the memory may alternatively include a memory located remotely from the processor, and these remote memories may be connected to the terminal via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The non-transitory software programs and instructions required to implement the chip control method in the above-described embodiments are stored in the memory and when executed by the one or more processors, the chip control method in the above-described embodiments is performed, for example, at least one of method steps S100 to S300 in fig. 1, method steps S410 to S430 in fig. 2, method steps S510 to S530 in fig. 3, method steps S610 to S650 in fig. 4, method steps S710 to S720 in fig. 5, and method steps S810 to S820 in fig. 6 described above is performed.
The present invention also provides a computer-readable storage medium storing computer-executable instructions for causing a computer to perform the chip control method in the above-described embodiment, for example, at least one of the method steps S100 to S300 in fig. 1, the method steps S410 to S430 in fig. 2, the method steps S510 to S530 in fig. 3, the method steps S610 to S650 in fig. 4, the method steps S710 to S720 in fig. 5, and the method steps S810 to S820 in fig. 6, which are described above.
The above described embodiments of the apparatus are only illustrative, wherein the units described as separate components may or may not be physically separate, i.e. may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge of one of ordinary skill in the art without departing from the spirit of the present invention.
Claims (8)
1. The chip control method is applied to control terminal equipment, the control terminal equipment comprises a processor, a memory and a plurality of image sensing chips, each image sensing chip is internally provided with a MEMS gyroscope, the memory is provided with a database for storing optimal correction parameters corresponding to offset data of each MEMS gyroscope, and the method comprises the following steps:
Receiving said offset data for each of said MEMS gyroscopes;
comparing the offset data with the database to obtain the corresponding optimal correction parameters;
The control terminal device further comprises a velocimeter, a register is arranged in the processor, and after comparing the offset data with the database, the control terminal device further comprises:
Acquiring the real-time speed of the image sensing chip;
Caching the offset data and the real-time speed into the register;
caching the optimal correction parameters corresponding to the offset data into the register;
Determining that the number of occurrences of the offset data and the real-time speed cached in the register reaches a preset threshold;
Calling the optimal correction parameters corresponding to the offset data in the register;
And correcting the movement of the image sensing chip according to the optimal correction parameters.
2. The chip control method according to claim 1, wherein the comparing the offset data with the database obtains the corresponding optimal correction parameters, specifically:
and comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameters.
3. The chip control method according to claim 2, wherein comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameter includes:
Setting any one of the image sensing chips as a reference chip;
determining the offset data of other image sensing chips according to the offset data of the reference chip;
And comparing the offset data of the other image sensing chips with the database to obtain the optimal correction parameters of the other image sensing chips.
4. The chip control method according to claim 2, wherein comparing the offset data with the database according to a preset comparison standard to obtain the corresponding optimal correction parameter includes:
Presetting reference parameters, wherein the reference parameters comprise a reference axis point and a reference angle;
Determining the offset data of the image sensing chip according to the reference parameters;
and comparing the offset data with the database to obtain the optimal correction parameters.
5. The chip control method according to claim 1, wherein a voltmeter is provided in the MEMS gyroscopes, further comprising, before the receiving the offset data of each of the MEMS gyroscopes:
Obtaining input voltage measured by the MEMS gyroscope, wherein the input voltage carries the offset data;
And determining that the input voltage is different from a preset voltage.
6. The chip control method according to claim 2, characterized in that the method further comprises:
obtaining photographic parameters of each image sensing chip;
and correcting the photographing parameters of the image sensing chip according to the preset comparison standard.
7. A control terminal device for implementing the chip control method of any one of claims 1 to 6, comprising:
A plurality of the image sensing chips are arranged, each image sensing chip is internally provided with an MEMS gyroscope;
the memory is provided with a database for storing the optimal correction parameters corresponding to the offset data of each MEMS gyroscope;
The processor is used for receiving the offset data of the image sensing chip measured by the MEMS gyroscope, comparing the offset data with the database and correcting the image sensing chip according to the corresponding optimal correction parameters;
The control terminal device further comprises a velocimeter, the processor is further provided with a register, the velocimeter is used for detecting the real-time speed of each image sensing chip, and the register is used for caching the real-time speed, the offset data and the corresponding optimal correction parameters.
8. A computer-readable storage medium, characterized in that a computer program is stored, which, when executed by a processor, implements the chip control method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210454027.2A CN114885079B (en) | 2022-04-27 | 2022-04-27 | Chip control method, control terminal device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210454027.2A CN114885079B (en) | 2022-04-27 | 2022-04-27 | Chip control method, control terminal device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114885079A CN114885079A (en) | 2022-08-09 |
| CN114885079B true CN114885079B (en) | 2025-07-29 |
Family
ID=82671104
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210454027.2A Active CN114885079B (en) | 2022-04-27 | 2022-04-27 | Chip control method, control terminal device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114885079B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106231180A (en) * | 2016-07-29 | 2016-12-14 | 广东欧珀移动通信有限公司 | Processing method, device and mobile terminal for panoramic photography |
| CN112437253A (en) * | 2020-10-22 | 2021-03-02 | 中航航空电子有限公司 | Video splicing method, device, system, computer equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100758632B1 (en) * | 2006-03-29 | 2007-09-14 | 삼성전자주식회사 | Panoramic photography device and method |
| JP6880080B2 (en) * | 2018-07-02 | 2021-06-02 | ベイジン ディディ インフィニティ テクノロジー アンド ディベロップメント カンパニー リミティッド | Vehicle navigation system using attitude estimation based on point cloud |
| CN109714536B (en) * | 2019-01-23 | 2021-02-23 | Oppo广东移动通信有限公司 | Image correction method, image correction device, electronic equipment and computer-readable storage medium |
-
2022
- 2022-04-27 CN CN202210454027.2A patent/CN114885079B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106231180A (en) * | 2016-07-29 | 2016-12-14 | 广东欧珀移动通信有限公司 | Processing method, device and mobile terminal for panoramic photography |
| CN112437253A (en) * | 2020-10-22 | 2021-03-02 | 中航航空电子有限公司 | Video splicing method, device, system, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114885079A (en) | 2022-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6875262B2 (en) | How to identify events in motion video | |
| US20170041545A1 (en) | Systems and methods for stabilizing images | |
| JP4653235B2 (en) | Composition of panoramic images using frame selection | |
| US11375097B2 (en) | Lens control method and apparatus and terminal | |
| JP2009508425A (en) | System and method for realizing motion-driven multi-shot image stabilization | |
| CN101485199A (en) | Methods and devices for video correction of still camera motion | |
| CN109922275B (en) | Self-adaptive adjustment method and device of exposure parameters and shooting equipment | |
| CN104219436A (en) | Optical device and control method therefor | |
| CN108603752B (en) | Declination detection method, shake compensation method and device of camera module of terminal | |
| CN110022433A (en) | Picture pick-up device, lens apparatus and its control method | |
| CN114125314B (en) | Brightness synchronization method, device, storage medium and equipment | |
| US10951815B2 (en) | Imaging device, imaging control method, electronic apparatus, and readable storage media | |
| CN112104842B (en) | Image acquisition equipment correction method, device, equipment and medium | |
| CN110753182B (en) | Adjusting method and apparatus of image forming apparatus | |
| US20070097221A1 (en) | Systems and methods of exposure restart for cameras | |
| CN113542612A (en) | Lens anti-shake method and device, computer equipment and storage medium | |
| US7844172B1 (en) | Adaptive autofocus lens positioning | |
| CN117294963A (en) | Image stabilizing method based on fusion of dynamic vision sensor and image sensor | |
| CN110418053A (en) | Lens apparatus and its control method and picture pick-up device and its control method | |
| CN114885079B (en) | Chip control method, control terminal device and computer readable storage medium | |
| CN113676673B (en) | Image acquisition method, image acquisition system and unmanned equipment | |
| US20070127902A1 (en) | Avoiding image artifacts caused by camera vibration | |
| CN114612360B (en) | Video fusion method and system based on motion model | |
| JP2017134185A (en) | Image blur correction apparatus, imaging apparatus, lens apparatus, image blur correction apparatus control method, program, and storage medium | |
| WO2023185584A1 (en) | Flight control method, unmanned aerial vehicle and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |