CN109982038A - Show the method, apparatus and computer equipment of sound source position - Google Patents
Show the method, apparatus and computer equipment of sound source position Download PDFInfo
- Publication number
- CN109982038A CN109982038A CN201910198943.2A CN201910198943A CN109982038A CN 109982038 A CN109982038 A CN 109982038A CN 201910198943 A CN201910198943 A CN 201910198943A CN 109982038 A CN109982038 A CN 109982038A
- Authority
- CN
- China
- Prior art keywords
- sound source
- camera
- location information
- information
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 239000011159 matrix material Substances 0.000 claims description 32
- 230000002159 abnormal effect Effects 0.000 claims description 25
- 238000003384 imaging method Methods 0.000 claims description 24
- 238000005516 engineering process Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012800 visualization Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 14
- 230000002547 anomalous effect Effects 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 6
- 241000209140 Triticum Species 0.000 description 4
- 235000021307 Triticum Nutrition 0.000 description 4
- 230000000295 complement effect Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 239000004973 liquid crystal related substance Substances 0.000 description 4
- 230000004807 localization Effects 0.000 description 4
- 229910044991 metal oxide Inorganic materials 0.000 description 4
- 150000004706 metal oxides Chemical class 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000002360 explosive Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
- G01S5/24—Position of single direction-finder fixed by determining direction of a plurality of spaced sources of known location
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/57—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for processing of video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
This application discloses a kind of method, apparatus and computer equipment for showing sound source position, method includes: the location information for obtaining sound source；According to the location information of the sound source, first coordinate information of the sound source in display screen is calculated；According to first coordinate information, the sound source position of the sound source is shown in the display screen.The visualization of sound source position is realized, in order to which user understands sound source spot at a distance.
Description
Technical field
This application involves field of communication technology is arrived, the method, apparatus and computer of display sound source position are especially related to
Equipment.
Background technique
Currently, video monitoring system has become the main means for obtaining the various information that anomalous event occurs.Wherein, big
The anomalous event that most public places occur generally all is accompanied by the generation of abnormal sound, and the generation of abnormal sound shows abnormal thing
Anomalous event, which will have occurred or has indicated, for part to occur.And existing Video Supervision Technique, mainly simply monitor event
When image or simple typing partial sound, in this way, monitoring personnel can only vision based on its own, the sense of hearing, it is artificial
Abnormal conditions are found in monitored picture, this is unfavorable for accurately and timely obtaining/understanding anomalous event, is also unfavorable for timely adopting
Take counter-measure.
Summary of the invention
The application's is designed to provide a kind of method, apparatus and computer equipment for showing sound source position, realizes aobvious
The position of sound source is shown in display screen or image.
The application proposes a kind of method for showing sound source position, comprising:
Obtain the location information of sound source；
According to the location information of sound source, first coordinate information of the sound source in display screen is calculated；
According to the first coordinate information, the sound source position of sound source is shown in display screen.
Further, before the step of obtaining the location information of sound source, comprising:
According to voice recognition technology, check whether sound source is abnormal sound source；
If so, generating the instruction for obtaining the location information of sound source.
Further, the location information of sound source includes column locations information of the sound source in the two-dimensional matrix of camera；It obtains
The step of location information of sound source, comprising:
Obtain first location information of the sound source relative to camera；
According to first location information, second location information of the sound source on the imaging surface of camera is obtained；
According to second location information, sound source is obtained in the column locations information of the two-dimensional matrix of camera.
Further, the step of obtaining first location information of the sound source relative to camera, comprising:
Obtain the third place information of the sound source relative to microphone array；
According to the first preset position information and the third place information of microphone array and camera, obtain sound source relative to
The first location information of camera.
Further, according to the location information of sound source, the step of calculating the first coordinate information of the sound source in display screen,
Include:
Obtain the size and maximum resolution of display screen；
Believed according to the size of display screen and maximum resolution and sound source in the column locations of the two-dimensional matrix of camera
Breath, calculates first coordinate information of the sound source in display screen.
Further, according to the first coordinate information, the step of sound source position of sound source is shown in display screen, comprising:
Obtain the image with sound source；
Image is shown in display screen；
According to the first coordinate information, the sound source position of sound source is marked in the picture.
Further, according to the first coordinate information, after the step of sound source position of sound source is shown in display screen, packet
It includes:
Obtain the rotation angle of display screen；
According to rotation angle and the first coordinate information, the second coordinate information in the display screen of sound source after rotation is calculated；
According to the second coordinate information, the sound source position of sound source is shown in display screen.
The application also proposes a kind of device for showing sound source position, comprising:
First obtains module, for obtaining the location information of sound source；
First computing module calculates first coordinate letter of the sound source in display screen for the location information according to sound source
Breath；
First display module, for showing the sound source position of sound source in display screen according to the first coordinate information.
Further, the location information of sound source includes column locations information of the sound source in the two-dimensional matrix of camera；First
Obtain module, comprising:
First acquisition unit, for obtaining first location information of the sound source relative to camera；
Second acquisition unit, for obtaining second of the sound source on the imaging surface of camera according to first location information
Confidence breath；
Third acquiring unit, for obtaining sound source in the ranks position of the two-dimensional matrix of camera according to second location information
Confidence breath.
The application also proposes that a kind of computer equipment, including memory and processor, memory are stored with computer program,
The step of processor realizes the method for above-mentioned display sound source position when executing computer program.
The application passes through the location information for obtaining sound source, to pass through sound for extrapolating position of the sound source in display screen
The positional information calculation in source goes out first coordinate information of the sound source in display screen, realizes the position that sound source is shown in display screen,
And then solve existing Video Supervision Technique, image or sound when event occurs mainly simply are monitored, and can only
It finds abnormal conditions according to user itself vision, the sense of hearing in the picture and can not accurately and rapidly obtain abnormal conditions, the application
By the specific location of display sound source in the picture, the visualization of sound source position is realized, in order to which user is even if remote
It can in time, quickly understand sound source spot, especially investigate anomalous event convenient for investigator, and be convenient for monitoring personnel
In time, the generation position for the event that fast and accurately notes abnormalities, and timely take corresponding counter-measure.
Detailed description of the invention
Fig. 1 is the step schematic diagram that the method for sound source position is shown in one embodiment of the application；
Fig. 2 is the structural schematic diagram that the device of sound source position is shown in one embodiment of the application；
Fig. 3 is the structural schematic diagram that the device of sound source position is shown in another embodiment of the application；
Fig. 4 is the first structural schematic diagram for obtaining module in the device for show in one embodiment of the application sound source position；
Fig. 5 is the structural schematic diagram of first acquisition unit in the device for show in one embodiment of the application sound source position；
Fig. 6 is the structural schematic diagram of the first computing module in the device for show in one embodiment of the application sound source position；
Fig. 7 is the structural schematic diagram of the first display module in the device for show in one embodiment of the application sound source position；
Fig. 8 is the structural schematic diagram that the device of sound source position is shown in the another embodiment of the application；
Fig. 9 is the structural schematic diagram of computer equipment in one embodiment of the application；
Figure 10 is the mathematical modeling schematic diagram that microphone array obtains sound source position in one embodiment of the application；
Figure 11 is mathematical modeling schematic diagram of the sound source position relative to camera in one embodiment of the application；
Figure 12 is mathematical modeling schematic diagram of the sound source position relative to the imaging surface of camera in one embodiment of the application；
Figure 13 is mathematical modeling schematic diagram of the sound source position relative to the two-dimensional matrix of camera in one embodiment of the application；
Figure 14 is the mathematical modeling schematic diagram that camera obtains sound source position place image in one embodiment of the application.
The embodiments will be further described with reference to the accompanying drawings for realization, functional characteristics and the advantage of the application purpose.
Specific embodiment
It should be appreciated that specific embodiment described herein is only used to explain the application, it is not used to limit the application.
Referring to Fig.1, the method for sound source position is shown in one embodiment of the application, comprising:
S1 obtains the location information of sound source；
S2 calculates first coordinate information of the sound source in display screen according to the location information of the sound source；
S3 shows the sound source position of the sound source according to first coordinate information in the display screen.
In above-mentioned steps S1, above-mentioned sound source position information can be preferably sound source in the two-dimensional matrix (back of camera
Will introduce) column locations information.In one embodiment, it can be obtained by microphone array according to sound source time delay localization technology
Position of the sound source relative to microphone array obtains sound source phase further according to the predeterminated position relationship of microphone array and camera
Position of the sound source on the imaging surface of camera eyeglass is obtained according to the image-forming principle of camera eyeglass for the position of camera
It sets, finally according to the pixel quantity of cmos sensor in camera eyeglass, obtains sound source in the row of the two-dimensional matrix of camera
Column position information.By obtaining the location information of sound source, position of the sound source in display screen can be further extrapolated.
In above-mentioned steps S2, the location information of sound source can be sent to the user terminal by network, for example, being mounted on
Microphone array on the camera and camera of traffic light intersection, after step S1 gets the location information of sound source,
The location information of sound source is sent to the display in the safety monitoring center of traffic light intersection, the position of sound source is shown by display
It sets.Specifically, due to the size of different display screens and maximum resolution difference, so same image is shown in different display screens
When, image definition and size also can be different, so will be according to the size and maximum resolution of a display screen and the position of sound source
Confidence breath, calculates first coordinate information of the sound source in the display screen.Further, can exist according to sound source is obtained in step S1
The column locations information of the two-dimensional matrix of camera calculates line information of the sound source in display screen, further according to display screen
Size and maximum resolution calculate the point of display screen away from the last line information and display screen according to sound source in display screen
Point away from calculating first coordinate information of the sound source in display screen, and then realize the position for showing sound source in display screen.
In above-mentioned steps S3, it can also be rotational display that above-mentioned sound source position, which can be the sound source position before rotational display screen,
Sound source position after screen.Rectangle frame or small circle, which preferably can be used, indicates the center of sound source, in display screen with matrix frame or
The form of circle shows the position of sound source, realizes sound source position visualization.In one embodiment, sound source institute is obtained by camera
Image in position marks the position of sound source, so that it is wherefrom to send out that user, which is more clear, gets information about sound source, on the image
Out, especially easily facilitate investigator by monitoring video investigate anomalous event, or make monitor observer in time,
The generation position for the event that fast and accurately notes abnormalities avoids more heavy loss to handle anomalous event in time.
In one embodiment, before the step S1 of the location information of the above-mentioned acquisition sound source, comprising:
S101 checks whether the sound source is abnormal sound source according to voice recognition technology；
S102, if so, generating the instruction for obtaining the location information of the sound source.
In above-mentioned steps S101 and step S102, it is above-mentioned exception sound source may include shot, explosive sound, glass breaking sound,
Shriek and consumingly object impact sound etc..Since the sound frequency etc. of different sound sources has differences, so voice recognition technology
Can be for by the difference between different sound sources, whether inspection sound source be abnormal sound source, specifically, establishes the sound of all normal sound sources
Model, and be stored in sound model library, after the corresponding voice signal of above-mentioned sound source is carried out feature extraction, modeling, with sound
Normal sound model in model library is matched, if successful match, sound source is not abnormal sound source, if it fails to match, in sound
Sound is abnormal sound source；In other embodiments, the sound model of all abnormal sound sources can also be established, and is stored in sound model
In library, after the corresponding voice signal of above-mentioned sound source is carried out feature extraction, modeling, with the abnormal sound model in sound model library
It is matched, if successful match, sound is abnormal sound source, if it fails to match, sound source is not abnormal sound source.If sound source is different
Chang Shengyuan just obtains sound source position and shows sound source position in display screen, to reduce the interference of other noises, normal sound, more
Add and meets user experience.
In one embodiment, the location information of above-mentioned sound source includes ranks of the sound source in the two-dimensional matrix of camera
Location information；Obtain the step S1 of the location information of the sound source, comprising:
S11 obtains first location information of the sound source relative to the camera；
S12 obtains the second position of the sound source on the imaging surface of the camera according to the first location information
Information；
S13 obtains the sound source in the column locations of the two-dimensional matrix of the camera according to the second location information
Information.
In above-mentioned steps S11, position of the sound source relative to microphone array, then root can be obtained by sound source time delay technology
According to the position and microphone array and the preset distance relation of camera, first location information of the sound source relative to camera is obtained
(x1, y1).
In above-mentioned steps S12, such as Figure 12, E is first location information (x1, y1) of the sound source relative to camera, and F is
Second location information (x2, y2) of the sound source on the imaging surface of the camera, the imaging surface of above-mentioned camera are camera
The imaging plane of eyeglass, the first location information according to sound source apart from camera, as location information of the sound source apart from eyeglass
(x1, y1) can calculate second of sound source on the imaging surface of the camera according to image-forming principle and using similar triangles
Location information (x2, y2), whereinF is eyeglass focal length.
In above-mentioned steps S13, need in the image lenses of camera using CMOS (Complementary Metal
Oxide Semiconductor, complementary metal oxide semiconductor) imaging sensor, and have very in the battle array structure of the face of CMOS
Multiple pixels, for example, camera eyeglass pixel be 12,000,000, then CMOS face battle array structure in have 12,000,000 it is photosensitive
Unit.Such as Figure 13, using picture planar central as origin, that is, center of lens projects to the point as plane, and the small grid on figure is just
It is photovoltaic sensing element on CMOS, that is, constitutes the minimum unit " pixel " (Pixel) of image.Between general cmos pixel point away from
It is determined from by manufacture craft, by each CMOS as a matrix dot, then all photosensitive elements can be as a Two-Dimensional Moment
Battle array, if this matrix is M row, N column.Wherein, the calculated relationship under different ppi (pixel quantity possessed per square inch)
It is different: setting the pixel of camera as M1*N1, if the size of photosensitive element chip is M2*N2, each light can be calculated
Distance between sensing device CMOS, and picture point is in the position on photosensitive element chip that (i.e. sound source is on the imaging surface of the camera
Second location information) be known (x2, y2), then can extrapolate the column locations information of pixel corresponding to pixel
(i.e. column locations information of the sound source in the two-dimensional matrix of the camera) (K, L), wherein
In one embodiment, the step of first location information of the above-mentioned acquisition sound source relative to the camera
S11, comprising:
S111 obtains the third place information of the sound source relative to microphone array；
S112, according to the first preset position information and the third place information of the microphone array and camera,
Obtain first location information of the sound source relative to the camera.
In above-mentioned steps S111, such as Figure 10, above-mentioned microphone array by taking four wheat circular array as an example (it is understood that
It is the microphone array for being also possible to other shapes, quantity), microphone A, B, C, D are defined on circle, and center of circle O is sound control
The center (i.e. the center of microphone array) of component processed, and plane right-angle coordinate, round radius are established by origin of center of circle O
For r, the distance of sound source Q to the center of circle is the straight line of s, center of circle O and sound source Q and the angle of reference axis X-axis is θ, sound source Q to microphone
A, the distance of B, C are respectively s1, s2, s3, wherein r is each microphone to the distance at sound control component center, is production sound
The radius preset when sound control assembly, as known quantity, in non-circular microphone array, each microphone to sound control group
The distance at part center can be unequal, but the known quantity that while being the manufacturing just presets；It is fixed according to cosine in trigonometric function
Li Ke get: Further obtain microphone A and sound
The geometrical relationship formula of the distance of source Q:Microphone B is several at a distance from sound source Q
What relational expression:And geometry of the microphone B at a distance from sound source Q closes
It is formula:Above-mentioned geometrical relationship formula is pre-stored in database or terminal memory, is needed
Above-mentioned geometrical relationship formula is read when wanting, and is calculated using geometric algorithm.The spread speed for defining sound is v, tBA、tBC
Respectively microphone B and microphone A receives the time difference of voice signal, microphone B and microphone C and receives voice signal
Time difference；According to plane geometry: vtBA=s2-s1、vtBC=s2-s3, according between above-mentioned each microphone and sound source away from
From geometrical relationship Shi Ke get: Wherein v, tBA、tBC, r be
Known quantity, it is possible to solve sound source Q and sound control component center O distance s, therefore, sound source is relative to microphone array
The third place information (scos θ, ssin θ).
In above-mentioned steps S112, if Figure 11, M are microphone array, S is camera, by microphone array and camera
Place plane establishes plane right-angle coordinate using camera as origin, microphone array can be at the eyeglass of camera upper left,
Upper right, lower-left, bottom right four direction, and microphone array is obtained at a distance from camera according to preset microphone array
Column and the distance, delta x of camera in the X-axis direction, microphone array and the distance, delta y of camera in the Y-axis direction, it is known that sound
The third place information (scos θ, ssin θ) of the source relative to microphone array, therefore, available sound source is relative to the camera shooting
First location information (scos θ ± Δ x, the ssin θ ± Δ y) of head.
It is noted that if microphone array is set up directly on camera, though microphone array and camera from
Must be close, but still there is a certain distance between the two, due to subsequent object side will be calculated according to the image-forming principle of camera
Position of the sound source on imaging surface, therefore, it is opposite to be converted to sound source for the third place information by sound source with respect to microphone array
After the first location information (i.e. with respect to the object side position of camera) of camera, the operations such as subsequent calculating, position are shown, it will
It is more accurate, it is to be understood that, can also be only close by the third place information in the application of less demanding of some accurate positionings
As be quite first location information, in this situation, operation is relatively simple.It, can also be with if microphone array is farther out from camera
By the transformation between above-mentioned the third place information and first location information, first of sound source with respect to camera required for obtaining
Location information, in this situation, the installation site of microphone array and camera will have more selectivity.
In one embodiment, the above-mentioned location information according to the sound source calculates the sound source in display screen
The step S2 of first coordinate information, comprising:
S21 obtains the size and maximum resolution of the display screen；
S22, according to the size of the display screen and maximum resolution and the sound source the camera Two-Dimensional Moment
The column locations information of battle array, calculates first coordinate information of the sound source in display screen.
It, can in the picture element position information of camera, (i.e. sound source be in the camera by sound source in above-mentioned steps S21
The column locations information of two-dimensional matrix) display equipment is sent to by transmission modes such as network/bluetooths or has display equipment
User APP, and by with display unit equipment show sound source position.Due to different display screens size and resolution ratio not
Together, the position for causing sound source to show in display screen is also different, so first obtaining the size and maximum resolution of display screen.
In above-mentioned steps S22, for display screen is with LCD (Liquid Crystal Display, liquid crystal display),
If the screen size of LCD is M3*N3, maximum resolution M4*N4, then can obtain a little away from (under different sizes between each pixel
Distance), be denoted as Δ d1 and Δ d2, wherein Δ d1=M3/M4, Δ d2=N3/N4.According to sound source the two of the camera
The column locations information (K, L) for tieing up matrix, is calculated sound source in the line information (K1, L1) of display screen, whereinAccording to point away from Δ d1 and Δ d2, first of sound source in display screen is calculated
Coordinate information (x3, y3), wherein x3=K1× Δ d1, y3=L1×Δd2。
In one embodiment, above-mentioned according to first coordinate information, the sound source is shown in the display screen
The step S3 of sound source position, comprising:
S31 obtains the image with the sound source；
S32 shows described image in the display screen；
S33 marks the sound source position of the sound source according to first coordinate information in described image.
In above-mentioned steps S31, the image of sound source position is obtained by camera.In one embodiment, such as Figure 14,
Camera A with microphone array gets the position of sound source, if but sound source not in the areas imaging of the camera, can
Multiple cameras are configured, according to the positional relationship of multiple cameras and the camera A with microphone array, can learn sound source
The position of that camera of opposite place image pickup scope, for example sound source is in the image pickup scope of camera B, then it can be according to sound
Source and the position of camera A and the position of camera A and camera B, extrapolate the positional relationship of camera B and sound source,
And then sound source position is shown in the image that camera B is obtained.In another embodiment, only one camera, then pass through sound
Source time delay localization technology obtains location information of the sound source relative to microphone array, in the position according to microphone array and camera
Relationship is set, obtains location information of the sound source relative to microphone array, and then only show position of the sound source in display screen.Certainly
In other embodiments, it can also be respectively mounted microphone array on multiple or even each camera, do not done herein in detail
It introduces.
In above-mentioned steps S32 and step S33, the image that will acquire is shown in display screen, and according to sound source aobvious
The first coordinate information in display screen, shows sound source position in display screen, to mark the sound source position of sound source in the picture.Specifically
Ground can be used rectangle frame or small circle and be drawn rectangle frame or small circle centered on point source of sound to mark the position of sound source in the picture
It sets, the size and color of rectangle frame or circle can be with sets itselfs.It is understood that the display mode of label, is conducive to use
Family visually more quickly, accurately, intuitively navigates to the position of sound source.
In one embodiment, above-mentioned according to first coordinate information, the sound source is shown in the display screen
After the step S3 of sound source position, further includes:
S41 obtains the rotation angle of the display screen；
S42 calculates the display of the sound source after rotation according to the rotation angle and first coordinate information
The second coordinate information in screen；
S43 shows the sound source position of the sound source according to second coordinate information in the display screen.
In above-mentioned steps S41, step S42 and step S43, for example, due to for compared with user, during the position with user is
The heart, when the direction of user becomes, the direction of equipment also becomes therewith, then the sound opposite with microphone array/camera of equipment
The location information in source can also change, but herein, the first coordinate information and equipment before being rotated by equipment are postrotational
Corresponding relationship between second coordinate information, to obtain the second coordinate information, after reacquiring sound source relative rotation
Camera location information, it is more simple and convenient without doing subsequent correlating transforms operation.Specifically, gyro can be passed through
Instrument and acceleration transducer measure the rotation angle [alpha] of equipment, and using screen center as origin, screen long side is X-axis, screen short side
For Y-axis, it is known that first coordinate information (x3, y3) of the sound source in display screen, then after equipment rotation, sound source in display screen the
Two coordinate informations are (x4, y4), wherein x4=x3cosα+y3Sin α, y4=y3cosα-x3sinα.According to the coordinate information,
The postrotational sound source position of equipment is shown in display screen.
It is understood that the application scenarios of present embodiment can have very much, in addition to some scenes mentioned above, also
It can apply on some intelligentized Furniture/electronic equipments with display screen, and microphone array can be set according to actual needs
It sets on intelligentized Furniture/electronic equipment, is also disposed at other places certainly.Above-mentioned intelligentized Furniture/electronic equipment can be with display
The intelligent sound box of screen, or be mounted in indoor monitoring camera head etc., exhaustion is not done herein.
Referring to Fig. 2, the device of sound source position is shown in one embodiment of the application, comprising:
First obtains module 1, for obtaining the location information of sound source；
First computing module 2 calculates of the sound source in display screen for the location information according to the sound source
One coordinate information；
First display module 3, for showing the sound of the sound source in the display screen according to first coordinate information
Source position.
It is obtained in module 1 above-mentioned first, above-mentioned sound source position information preferably can be Two-Dimensional Moment of the sound source in camera
The column locations information of battle array (will introduce below).It in one embodiment, can be by microphone array according to sound source time delay localization
Technology obtains position of the sound source relative to microphone array and obtains further according to the predeterminated position relationship of microphone array and camera
Position of the sound source relative to camera is taken, according to the image-forming principle of camera eyeglass, obtains sound source in the imaging of camera eyeglass
Position on face obtains sound source in the two dimension of camera finally according to the pixel quantity of cmos sensor in camera eyeglass
The column locations information of matrix.By obtaining the location information of sound source, position of the sound source in display screen can be further extrapolated.
In above-mentioned first computing module 2, the location information of sound source can be sent to the user terminal by network, for example,
Microphone array on the camera and camera for being mounted on traffic light intersection is getting sound by the first acquisition module 1
After the location information in source, the location information of sound source is sent to the display in the safety monitoring center of traffic light intersection, by showing
Show that device shows the position of sound source.Specifically, due to the size of different display screens and maximum resolution difference, so same image
When being shown in different display screens, image definition and size also can be different, so according to the size and maximum resolution of display screen
And the location information of sound source, calculate first coordinate information of the sound source in the display screen.Further, it can be obtained according to first
Modulus block 1 obtains sound source in the column locations information of the two-dimensional matrix of camera, calculates ranks letter of the sound source in display screen
Breath, size and maximum resolution further according to display screen calculate the point of display screen away from finally according to sound source in display screen
The point of line information and display screen is away from calculating first coordinate information of the sound source in display screen, and then realize in display screen
The position of middle display sound source.
In above-mentioned first display module 3, above-mentioned sound source position can be the sound source position before rotational display screen, can also be rotation
Sound source position after turning display screen.Rectangle frame or small circle, which preferably can be used, indicates the center of sound source, with square in display screen
The form of battle array frame or circle shows the position of sound source.In one embodiment, the image of sound source position is obtained by camera,
The position of sound source is marked on the image, so that user is more clear, gets information about sound source and wherefrom issue, especially
It easily facilitates investigator and anomalous event is investigated by monitoring video, or send out monitoring observer in time, fast and accurately
The generation position of existing anomalous event avoids more heavy loss to handle anomalous event in time.
Referring to Fig. 3, in one embodiment, above-mentioned apparatus, further includes:
Module 101 is checked, for checking whether the sound source is abnormal sound source according to voice recognition technology；
Generation module 102, for if so, generating the instruction for obtaining the location information of the sound source.
In above-mentioned inspection module 101 and generation module 102, above-mentioned exception sound source may include that shot, explosive sound, glass are broken
Broken sound, shriek and consumingly object impact sound etc..Since the sound frequency etc. of different sound sources has differences, so voice recognition
Technology can be for by the difference between different sound sources, whether inspection sound source be abnormal sound source, specifically, establishes all normal sound sources
Sound model, and be stored in sound model library, after the corresponding voice signal of above-mentioned sound source is carried out feature extraction, modeling, with
Normal sound model in sound model library is matched, if successful match, sound source is not abnormal sound source, if it fails to match,
It is abnormal sound source in sound；In other embodiments, the sound model of all abnormal sound sources can also be established, and is stored in sound
In model library, after the corresponding voice signal of above-mentioned sound source is carried out feature extraction, modeling, with the abnormal sound in sound model library
Model is matched, if successful match, sound is abnormal sound source, if it fails to match, sound source is not abnormal sound source.If sound source
That abnormal sound source just obtains sound source position and shows sound source position in display screen, with reduce other noises, normal sound it is dry
It disturbs, is more in line with user experience.
Referring to Fig. 4, in one embodiment, the location information of above-mentioned sound source includes Two-Dimensional Moment of the sound source in camera
The column locations information of battle array；Above-mentioned first obtains module 1, comprising:
First acquisition unit 11, for obtaining first location information of the sound source relative to the camera；
Second acquisition unit 12, for according to the first location information, obtain the sound source the camera at
Second location information in image planes；
Third acquiring unit 13, for obtaining the sound source the two of the camera according to the second location information
Tie up the column locations information of matrix.
In above-mentioned first acquisition unit 11, position of the sound source relative to microphone array can be obtained by sound source time delay technology
It sets, further according to the position and microphone array and the preset distance relation of camera, obtains first of sound source relative to camera
Location information (x1, y1).
In above-mentioned second acquisition unit 12, such as Figure 12, E be sound source relative to camera first location information (x1,
Y1), F is second location information (x2, y2) of the sound source on the imaging surface of the camera, and the imaging surface of above-mentioned camera is to take the photograph
As the imaging plane of the eyeglass of head, first location information according to sound source apart from camera, as position of the sound source apart from eyeglass
Information (x1, y1) can calculate sound source on the imaging surface of the camera according to image-forming principle and using similar triangles
Second location information (x2, y2), whereinF is eyeglass focal length.
In above-mentioned third acquiring unit 13, need in the image lenses of camera using CMOS (Complementary
Metal Oxide Semiconductor, complementary metal oxide semiconductor) imaging sensor, and in the face of CMOS battle array structure
In have many pixels, for example the pixel of eyeglass of camera is 12,000,000, then has 12,000,000 in the battle array structure of the face of CMOS
A photosensitive unit.Such as Figure 13, using picture planar central as origin, that is, center of lens projects to the point as plane, small on figure
Grid is exactly photovoltaic sensing element on CMOS, that is, constitutes the minimum unit " pixel " (Pixel) of image.General CMOS pixel
The distance between determined by manufacture craft, by each CMOS as a matrix dot, then all photosensitive elements can be as one
A two-dimensional matrix, if this matrix is M row, N column.Wherein, under different ppi (pixel quantity possessed per square inch)
Calculated relationship is also different: being set the pixel of camera as M1*N1, if the size of photosensitive element chip is M2*N2, can be counted
The distance between each light-sensitive device CMOS is calculated, and (i.e. sound source is in the camera shooting for position of the pixel on photosensitive element chip
Second location information on the imaging surface of head) it is known (x2, y2), then it can extrapolate the row of pixel corresponding to pixel
Column position information (i.e. column locations information of the sound source in the two-dimensional matrix of the camera) (K, L), wherein
Referring to Fig. 5, in one embodiment, above-mentioned first acquisition unit 11, comprising:
First obtains subelement 111, for obtaining the third place information of the sound source relative to microphone array；
Second obtains subelement 112, for according to the first preset position information of the microphone array and camera and
The third place information obtains first location information of the sound source relative to the camera.
It is obtained in subelement 111 above-mentioned first, such as Figure 10, above-mentioned microphone array (can by taking four wheat circular array as an example
With understanding, it is also possible to the microphone array of other shapes, quantity), microphone A, B, C, D are defined on circle, and center of circle O is
The center (i.e. the center of microphone array) of sound control component, and plane right-angle coordinate is established by origin of center of circle O, circle
Radius is r, and the distance of sound source Q to the center of circle is the straight line of s, center of circle O and sound source Q and the angle of reference axis X-axis is θ, sound source Q to wheat
The distance of gram wind A, B, C are respectively s1, s2, s3, wherein r is the distance that each microphone arrives sound control component center, is to produce
The radius preset when sound control component, as known quantity, in non-circular microphone array, each microphone to sound control
The distance at component center can be unequal, but the known quantity that while being the manufacturing just presets；According to cosine in trigonometric function
Theorem can obtain: Further obtain geometrical relationship formula of the microphone A at a distance from sound source Q:Geometrical relationship formula of the microphone B at a distance from sound source Q:And geometrical relationship formula of the microphone B at a distance from sound source Q:Above-mentioned geometrical relationship formula is pre-stored in database or terminal memory, is read when needing
Above-mentioned geometrical relationship formula is taken, is calculated using geometric algorithm.The spread speed for defining sound is v, tBA、tBCRespectively
Microphone B and microphone A receives the time that the time difference of voice signal, microphone B and microphone C receive voice signal
Difference；According to plane geometry: vtBA=s2-s1、vtBC×s2-s3, according to above-mentioned each microphone between sound source at a distance from
Geometrical relationship Shi Ke get: Wherein v, tBA、tBC、 r
For known quantity, it is possible to solve sound source Q and sound control component center O distance s, therefore, sound source is relative to microphone array
The third place information (scos θ, ssin θ) of column.
It is obtained in subelement 112 above-mentioned second, if Figure 11, M are microphone array, S is camera, by microphone array
With plane where camera, plane right-angle coordinate is established by origin of camera, microphone array can be at the mirror of camera
The upper left of piece, upper right lower-left bottom right four direction, and wheat is obtained at a distance from camera according to preset microphone array
Gram wind array and the distance, delta x of camera in the X-axis direction, microphone array and the distance, delta y of camera in the Y-axis direction,
The third place information (scos θ, ssin θ) of the known sound source relative to microphone array, therefore, available sound source is relative to institute
State first location information (scos θ ± Δ x, the ssin θ ± Δ y) of camera.
It is noted that if microphone array is set up directly on camera, though microphone array and camera from
Must be close, but still there is a certain distance between the two, due to subsequent object side will be calculated according to the image-forming principle of camera
Position of the sound source on imaging surface, therefore, it is opposite to be converted to sound source for the third place information by sound source with respect to microphone array
After the first location information (i.e. with respect to the object side position of camera) of camera, the operations such as subsequent calculating, position are shown, it will
It is more accurate, it is to be understood that, can also be only close by the third place information in the application of less demanding of some accurate positionings
As be quite first location information, in this situation, operation is relatively simple.It, can also be with if microphone array is farther out from camera
By the transformation between above-mentioned the third place information and first location information, first of sound source with respect to camera required for obtaining
Location information, in this situation, the installation site of microphone array and camera will have more selectivity.
Referring to Fig. 6, in one embodiment, above-mentioned first computing module 2, comprising:
4th acquiring unit 21, for obtaining the size and maximum resolution of the display screen；
Computing unit 22, for being taken the photograph according to the size and maximum resolution and the sound source of the display screen described
As the column locations information of the two-dimensional matrix of head, first coordinate information of the sound source in display screen is calculated.
It, can in the picture element position information of camera, (i.e. sound source be described by sound source in above-mentioned 4th acquiring unit 21
The column locations information of the two-dimensional matrix of camera) display equipment is sent to by transmission modes such as network/bluetooths or is had
It shows the user APP of equipment, and sound source position is shown by the equipment with display unit.Due to different display screens size and point
Resolution is different, and the position for causing sound source to show in display screen is also different, so first obtaining the size and maximum resolution of display screen
Rate.
In above-mentioned computing unit 22, display screen is with LCD (Liquid Crystal Display, liquid crystal display)
Example, if the screen size of LCD be M3*N3, maximum resolution M4*N4, then can obtain a little away from (under different sizes each pixel it
Between distance), be denoted as Δ d1 and Δ d2, wherein Δ d1=M3/ M4, Δ d2=N3/N4.According to sound source in the camera
Sound source is calculated in the line information (K1, L1) of display screen in the column locations information (K, L) of two-dimensional matrix, wherein According to point away from Δ d1 and Δ d2, first of sound source in display screen is calculated
Coordinate information (x3, y3), wherein x3=K1× Δ d1, y3=L1×Δd2。
Referring to Fig. 7, in one embodiment, above-mentioned first display module 3, comprising:
5th acquiring unit 31, for obtaining the image with the sound source；
Display unit 32, for showing described image in the display screen；
Marking unit 33, for marking the sound source position of the sound source in described image according to first coordinate information
It sets.
In above-mentioned 5th acquiring unit 31, the image of sound source position is obtained by camera.In one embodiment,
If Figure 14, the camera A with microphone array get the position of sound source, if but sound source not in the areas imaging of the camera
It is interior, then it can configure multiple cameras, it, can be with according to the positional relationship of multiple cameras and the camera A with microphone array
Learn position of the sound source with respect to that camera of place image pickup scope, for example sound source is in the image pickup scope of camera B, then
The position of camera B and sound source can be extrapolated according to sound source and the position of camera A and the position of camera A and camera B
Relationship is set, and then shows sound source position in the image that camera B is obtained.In another embodiment, only one camera, then
Location information of the sound source relative to microphone array is obtained by sound source time delay localization technology, according to microphone array and camera shooting
The positional relationship of head obtains location information of the sound source relative to microphone array, and then only shows position of the sound source in display screen
It sets.Certainly in other embodiments, it can also be respectively mounted microphone array on multiple or even each camera, herein not
It is described in detail.
In above-mentioned display unit 32 and marking unit 33, the image that will acquire is shown in display screen, and according to sound
First coordinate information of the source in display screen, shows sound source position in display screen, to mark the sound source position of sound source in the picture
It sets.Specifically, rectangle frame or small circle can be used and draw rectangle frame or small circle centered on point source of sound to mark sound source in image
In position, the size and color of rectangle frame or circle can be with sets itselfs.It is understood that the display mode of label, has
The position of sound source visually more quickly, accurately, is intuitively navigated to conducive to user.
Referring to Fig. 8, in one embodiment, above-mentioned apparatus, further includes:
Second obtains module 41, for obtaining the rotation angle of the display screen；
Second computing module 42, for calculating the sound source and existing according to the rotation angle and first coordinate information
The second coordinate information in the postrotational display screen；
Second display module 43, for showing the sound source in the display screen according to second coordinate information
Sound source position.
It is obtained in module 41, the second computing module 42 and the second display module 43 above-mentioned second, for example, due to compared with user
For, centered on the position of user, when the direction of user becomes, the direction of equipment also becomes therewith, then with the Mike of equipment
Wind array/camera opposite sound source position can also change, but herein, the first coordinate letter before being rotated by equipment
Corresponding relationship between breath and postrotational second coordinate information of equipment, to obtain the second coordinate information, without obtaining again
The location information of camera after taking sound source relative rotation, it is more simple and convenient without doing subsequent correlating transforms operation.Tool
Body, the rotation angle [alpha] of equipment can be measured by gyroscope and acceleration transducer, using screen center as origin, screen is long
While being X-axis, screen short side is Y-axis, it is known that first coordinate information (x3, y3) of the sound source in display screen, then after equipment rotation,
Second coordinate information of the sound source in display screen is (x4, y4), wherein x4=x3cosα+y3Sin α, y4=y3cosα-x3sin
α.According to the coordinate information, the postrotational sound source position of equipment is shown in display screen.
Referring to Fig. 9, in one embodiment of the application, computer equipment 1001 includes memory 1003 and processor 1002, institute
It states memory 1003 and is stored with computer program 1004, the processor 1002 is realized when executing the computer program 1004
The step of stating the method for display sound source position.
It will be understood by those skilled in the art that computer equipment described herein is above-mentioned involved for executing this Shen
Please described in one or more equipment in method.These equipment can specially design and manufacture for required purpose, or
Person also may include the known device in general purpose computer.These equipment have the computer program being stored in it or using journeys
Sequence, these computer programs are selectively activated or are reconstructed.Such computer program can be stored in equipment (for example, meter
Calculation machine) in readable medium or it is stored in and is suitable for storage e-command and is coupled in any kind of medium of bus respectively,
The computer-readable medium includes but is not limited to any kind of disk (including floppy disk, hard disk, CD, CD-ROM and magneto-optic
Disk), ROM (Read-Only Memory, read-only memory), RAM (Random Access Memory, random access memory),
EPROM (Erasable Programmable Read-Only Memory, Erarable Programmable Read only Memory), EEPROM
(Electrically Erasable Programmable Read-Only Memory, Electrically Erasable Programmable Read-Only Memory),
Flash memory, magnetic card or light card.It is, readable medium includes the form by equipment (for example, computer) can read
Any medium of storage or transmission information.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, device, article or the method that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, device, article or method institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, device of element, article or method.
The foregoing is merely preferred embodiment of the present application, are not intended to limit the scope of the patents of the application, all utilizations
Equivalent structure or equivalent flow shift made by present specification and accompanying drawing content is applied directly or indirectly in other correlations
Technical field, similarly include in the scope of patent protection of the application.
Claims (10)
1. a kind of method for showing sound source position characterized by comprising
Obtain the location information of sound source；
According to the location information of the sound source, first coordinate information of the sound source in display screen is calculated；
According to first coordinate information, the sound source position of the sound source is shown in the display screen.
2. the method for display sound source position according to claim 1, which is characterized in that the location information for obtaining sound source
The step of before, comprising:
According to voice recognition technology, check whether the sound source is abnormal sound source；
If so, generating the instruction for obtaining the location information of the sound source.
3. the method for display sound source position according to claim 1, which is characterized in that the location information of the sound source includes
Column locations information of the sound source in the two-dimensional matrix of camera；The step of location information for obtaining sound source, comprising:
Obtain first location information of the sound source relative to the camera；
According to the first location information, second location information of the sound source on the imaging surface of the camera is obtained；
According to the second location information, the sound source is obtained in the column locations information of the two-dimensional matrix of the camera.
4. the method for display sound source position according to claim 3, which is characterized in that it is described obtain the sound source relative to
The step of first location information of the camera, comprising:
Obtain the third place information of the sound source relative to microphone array；
According to the first preset position information and the third place information of the microphone array and the camera, institute is obtained
State first location information of the sound source relative to the camera.
5. the method for display sound source position according to claim 3, which is characterized in that the position according to the sound source
Information, the step of calculating the first coordinate information of the sound source in display screen, comprising:
Obtain the size and maximum resolution of the display screen；
According to the size of the display screen and maximum resolution and the sound source the two-dimensional matrix of the camera ranks
Location information calculates first coordinate information of the sound source in display screen.
6. the method for display sound source position according to claim 1, which is characterized in that described to be believed according to first coordinate
The step of ceasing, the sound source position of the sound source shown in the display screen, comprising:
Obtain the image with the sound source；
Described image is shown in the display screen；
According to first coordinate information, the sound source position of the sound source is marked in described image.
7. the method for display sound source position according to claim 6, which is characterized in that described to be believed according to first coordinate
After the step of ceasing, the sound source position of the sound source shown in the display screen, comprising:
Obtain the rotation angle of the display screen；
According to the rotation angle and first coordinate information, in the display screen of the sound source after rotation is calculated
Two coordinate informations；
According to second coordinate information, the sound source position of the sound source is shown in the display screen.
8. a kind of device for showing sound source position characterized by comprising
First obtains module, for obtaining the location information of the sound source；
First computing module calculates first seat of the sound source in display screen for the location information according to the sound source
Mark information；
First display module, for showing the sound source position of the sound source in the display screen according to first coordinate information
It sets.
9. the device of display sound source position according to claim 8, which is characterized in that the location information of the sound source includes
Column locations information of the sound source in the two-dimensional matrix of camera；Described first obtains module, comprising:
First acquisition unit, for obtaining first location information of the sound source relative to the camera；
Second acquisition unit, for obtaining the sound source on the imaging surface of the camera according to the first location information
Second location information；
Third acquiring unit, for obtaining the sound source in the two-dimensional matrix of the camera according to the second location information
Column locations information.
10. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 7 the method when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910198943.2A CN109982038A (en) | 2019-03-15 | 2019-03-15 | Show the method, apparatus and computer equipment of sound source position |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910198943.2A CN109982038A (en) | 2019-03-15 | 2019-03-15 | Show the method, apparatus and computer equipment of sound source position |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109982038A true CN109982038A (en) | 2019-07-05 |
Family
ID=67079126
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910198943.2A Pending CN109982038A (en) | 2019-03-15 | 2019-03-15 | Show the method, apparatus and computer equipment of sound source position |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109982038A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110673819A (en) * | 2019-09-18 | 2020-01-10 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN112098937A (en) * | 2020-04-16 | 2020-12-18 | 苏州触达信息技术有限公司 | Intelligent device positioning method and intelligent device |
| CN112485760A (en) * | 2020-10-27 | 2021-03-12 | 上海影创信息科技有限公司 | Positioning system, method and medium based on spatial sound effect |
| CN112992178A (en) * | 2021-02-05 | 2021-06-18 | 安徽绿舟科技有限公司 | Method for analyzing pipeline leakage through chaotic voiceprint |
| WO2021208398A1 (en) * | 2020-04-16 | 2021-10-21 | 深圳市沃特沃德股份有限公司 | Method and apparatus for line-of-sight measurement and positioning, and computer device |
| CN114463179A (en) * | 2022-02-10 | 2022-05-10 | 北京航空工程技术研究中心 | A closed space multi-camera image stitching method for sound source localization determination |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014229965A (en) * | 2013-05-20 | 2014-12-08 | カシオ計算機株式会社 | Sound source position display device, sound source position display method and program |
| US20170099459A1 (en) * | 2015-10-05 | 2017-04-06 | Polycom, Inc. | Conversational placement of speakers at one endpoint |
| CN106679651A (en) * | 2017-02-08 | 2017-05-17 | 北京地平线信息技术有限公司 | Sound localization method and device and electronic equipment |
| CN106950542A (en) * | 2016-01-06 | 2017-07-14 | 中兴通讯股份有限公司 | The localization method of sound source, apparatus and system |
| CN107064878A (en) * | 2017-06-28 | 2017-08-18 | 山东大学 | A kind of sound localization method based on high-precision GPS and its realize system |
-
2019
- 2019-03-15 CN CN201910198943.2A patent/CN109982038A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2014229965A (en) * | 2013-05-20 | 2014-12-08 | カシオ計算機株式会社 | Sound source position display device, sound source position display method and program |
| US20170099459A1 (en) * | 2015-10-05 | 2017-04-06 | Polycom, Inc. | Conversational placement of speakers at one endpoint |
| CN106950542A (en) * | 2016-01-06 | 2017-07-14 | 中兴通讯股份有限公司 | The localization method of sound source, apparatus and system |
| CN106679651A (en) * | 2017-02-08 | 2017-05-17 | 北京地平线信息技术有限公司 | Sound localization method and device and electronic equipment |
| CN107064878A (en) * | 2017-06-28 | 2017-08-18 | 山东大学 | A kind of sound localization method based on high-precision GPS and its realize system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110673819A (en) * | 2019-09-18 | 2020-01-10 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN112098937A (en) * | 2020-04-16 | 2020-12-18 | 苏州触达信息技术有限公司 | Intelligent device positioning method and intelligent device |
| WO2021208398A1 (en) * | 2020-04-16 | 2021-10-21 | 深圳市沃特沃德股份有限公司 | Method and apparatus for line-of-sight measurement and positioning, and computer device |
| CN112098937B (en) * | 2020-04-16 | 2024-05-14 | 苏州触达信息技术有限公司 | Positioning method of intelligent equipment and intelligent equipment |
| CN112485760A (en) * | 2020-10-27 | 2021-03-12 | 上海影创信息科技有限公司 | Positioning system, method and medium based on spatial sound effect |
| CN112992178A (en) * | 2021-02-05 | 2021-06-18 | 安徽绿舟科技有限公司 | Method for analyzing pipeline leakage through chaotic voiceprint |
| CN114463179A (en) * | 2022-02-10 | 2022-05-10 | 北京航空工程技术研究中心 | A closed space multi-camera image stitching method for sound source localization determination |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109982038A (en) | Show the method, apparatus and computer equipment of sound source position | |
| US9401050B2 (en) | Recalibration of a flexible mixed reality device | |
| US10290154B1 (en) | Stereo-based calibration apparatus | |
| US8704857B2 (en) | Three-dimensional display device, mobile terminal and three-dimensional display tracking method | |
| JP4690476B2 (en) | Car camera calibration system | |
| JP4803450B2 (en) | On-vehicle camera calibration device and vehicle production method using the device | |
| EP2458405A1 (en) | Graphics-aided remote position measurement with handheld geodesic device | |
| US9194931B2 (en) | Length measurement method and device of the same | |
| CN110176030A (en) | A kind of autoegistration method, device and the electronic equipment of unmanned plane image | |
| EP2312330A1 (en) | Graphics-aided remote position measurement with handheld geodesic device | |
| CN109690622A (en) | Camera registration in a multi-camera system | |
| CN102446048B (en) | Information processing device and information processing method | |
| US20250182318A1 (en) | Information terminal apparatus and position recognition sharing method | |
| US20130135463A1 (en) | Information processing apparatus, information processing method and computer-readable storage medium | |
| EP3343242B1 (en) | Tracking system, tracking device and tracking method | |
| US20170146799A1 (en) | Coordinate matching apparatus for head-up display | |
| CN108344401A (en) | Localization method, device and computer readable storage medium | |
| CN111798521A (en) | Calibration method, device, storage medium and electronic device | |
| JP2010217984A (en) | Image detector and image detection method | |
| CN116443028A (en) | Head posture data acquisition system and method | |
| WO2016187752A1 (en) | Method and device for measuring antenna attitude | |
| CN116071507A (en) | Information processing device, information processing system, information processing method, and recording medium | |
| JP2008177742A (en) | Camera parameter acquisition device | |
| WO2015170439A1 (en) | Vehicle-mounted calibration device | |
| CN107796386B (en) | Horizontal defect detection method and system for PCB of head-mounted equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190705 |
|
| RJ01 | Rejection of invention patent application after publication |