|Publication number||US5521981 A|
|Application number||US 08/178,045|
|Publication date||28 May 1996|
|Filing date||6 Jan 1994|
|Priority date||6 Jan 1994|
|Publication number||08178045, 178045, US 5521981 A, US 5521981A, US-A-5521981, US5521981 A, US5521981A|
|Inventors||Louis S. Gehring|
|Original Assignee||Gehring; Louis S.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (9), Referenced by (78), Classifications (7), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
Human hearing is spatial and three-dimensional in nature. That is, a listener with normal hearing knows the spatial location of objects which produce sound in his environment. For example, in FIG. 1 the individual shown could hear the sound at S1 upward and slightly to the rear. He senses not only that something has emitted a sound, but also where it is even if he can't see it. Natural spatial hearing is also called binaural hearing; it allows us to near the musicians in an orchestra in their separate locations, to separate the different voices around us at a cocktail party, and to locate an airplane flying overhead.
Scientific literature relating to binaural hearing shows that the principal acoustic features which make spatial hearing possible are the position and separation of the ears on the head and also the complex shape of the pinnae, the external ears. When a sound arrives, the listener senses the direction and distance of its source by the changes these external features have made in the sound when it arrives as separate left arid right signals at the respective eardrums. Sounds which have been changed in this manner can be said to have binaural location cues: when they are heard, the sounds seem to come from the correct three-dimensional spatial location. As any listener can readily test, our natural binaural hearing allows hearing many sounds at different locations all around and at the same time.
Binaural sound and commercial stereophonic sound are both conveyed with two signals, one for each ear. The difference is that commercial stereophonic sound usually is recorded without spatial location cues; that is, the usual microphone recording process does not preserve the binaural cuing required for the sound to be perceived as three-dimensional. Accordingly, normal stereo sounds on headphones seem to be inside the listener's head, without any fixed location, whereas binaural sounds seem to come from correct locations outside the head, just as if the sounds were natural.
There are numerous applications for binaural sound, particularly since it can be played back on normal stereo equipment. Consider music where instruments are all around the listener, moved or "flown" by the performer; video games where friends or foes can be heard coming from behind; interactive television where things can be heard approaching offscreen before they appear; loudspeaker music playback where the instruments can be heard above or below the speakers and outside them.
One well-known early development in this field consisted of a dummy head ("kunstkopf") with two recording microphones in realistic ears: binaural sounds recorded with such a device can be compellingly spatial and realistic. A disadvantage of this method is that the sounds' original spatial locations can be captured, but not edited or modified. Accordingly, this earlier mechanical means of binaural processing would not be useful, for example, in a videogame where the sound needs to be interactively repositioned during game play or in a cockpit environment where the direction of an approaching missile and its sound could not be known in advance.
Recent developments in binaural processing use a digital signal processor (DSP) to mathematically emulate the dummy head process in real time but with positionable sound location. Typically, the combined effect of the head, ear, and pinnae are represented by a left-right pair of head-related transfer functions (HRTFs) corresponding to spherical directions around the listener, usually described angularly as degrees of azimuth and elevation relative to the listener's head as indicated in FIG. 1. The said HRTFs may arise from laboratory measurements or may be derived by means known to those skilled in the art. By then applying a mathematical process known as convolution wherein the digitized original sound is convolved in real time with the left- and right-ear HRTFs corresponding to the desired spatial location, right- and left-ear binaural signals are produced which, when heard, seem to come from the desired location. To reposition the sound, the HRTFs are changed to those for the desired new location. FIG. 2 is a block diagram illustrative of a typical binaural processor.
DSP-based binaural systems are known to be effective but are costly because the required real time convolution processing typically consumes about ten million instructions per second (MIPS) signal processing power for each sound. This means, for example, that using real time convolution to create the binaural sounds for a video game with eight objects, not an uncommon number, would require over eighty MIPS of signal processing. Binaurally presenting a musical composition with thirty-two sampled instruments controlled by the Musical Instrument Digital Interface (MIDI) would require over three hundred MIPS, a substantial computing burden.
The present invention was developed as an economical means to bring these applications and many others into the realm of practicality. Rather than needing a DSP and real time binaural convolution processing, the present invention provides means to achieve real time, responsive binaural sound positioning with inexpensive small computer central processing units (CPUs), typical "sampler" circuits widely used in the music and computer sound industries, or analog audio hardware.
A sound positioning apparatus comprising means of playing back binaural sounds with three-dimensional spatial position responsively controllable in real time and including means of preprocessing the said sounds so they can be spatially positioned by the said playback means. The burdensome processing task of binaural convolution required for spatial sound is performed in advance by the preprocessing means so that the binaural sounds are spatially positionable on playback without significant processing cost.
FIG. 1 is a drawing illustrating the usual angular coordinate system for spatial sound.
FIG. 2 is a block diagram of a typical binaural convolution processor.
FIG. 3 is a block diagram illustrating preprocessing means.
FIG. 4 is a block diagram illustrating playback means and spherical position interpreting means.
FIG. 5 is a drawing showing angular positions and a tabular chart of mixing apparatus control settings related to the said angular positions.
In accordance with the principles of the present invention, a binaural convolution processing means (the "preprocessor") is used to generate multiple binaurally processed versions ("preprocessed versions") of the original sound where each preprocessed version comprises the sound convolved through HRTFs corresponding to a different predefined spherical direction (or, interchangeably, point on a surrounding sphere rather than "spherical direction"). The number and spherical directions of preprocessed versions are as required to cover, that is enclose within great circle segments connecting the respective points on the surrounding sphere, the part of the sphere around the listener where it will be desirable to position the sound on playback.
In one example six preprocessed versions having twelve left- and right-ear binaural signals could be generated to cover the whole sphere as follows: front (0° azimuth, 0° elevation); right (90° azimuth, 0° elevation); rear (180° azimuth, 0° elevation); left (270° azimuth, 0° elevation) , top (90° elevation); and bottom (-90° elevation). This configuration would be useful for applications such as air combat simulation where sounds could come from any spherical direction around the pilot. In another example, only three similarly preprocessed versions would be required to cover the forward half of the horizontal plane as follows: left, front, and right. This arrangement would require only half the preprocessed data of the previous example and would be sufficient for presenting the sound of a musical instrument appearing anywhere on a level stage where elevation is not needed. A third example, responsive to the requirements of some three-dimensional video games, would use five similarly preprocessed versions corresponding to the front, right, rear, left, and top to allow sounds to come from anywhere in the upper hemisphere. In this example five-sixths of the preprocessed data of the first example would be generated.
These preceding three examples use preprocessed versions positioned rectilinearly at 90° increments. Obviously coverage of all or part of the sphere could also be achieved by many other arrangements; for example, a regular tetrahedron of four preprocessed versions would cover the whole sphere. Although such other arrangements are usable within the scope of the present invention, arrangements like the first three examples which are bilaterally symmetrical are the preferred embodiment because they have an advantage which arises in the following manner:
Normal human spatial hearing is known to be bilaterally symmetrical, i.e. the directional responses of the left and right ears are approximate mirror images in azimuth. This attribute makes it possible to move a sound to the mirror-image location in the opposite lateral hemisphere by simply reversing the binaural signals applied to the listener's left and right eardrums. In FIG. 1, for example, the spatial sound shown at S1 and having an angular position indicated at A1 will seem to move to the mirror-image position S2 with the mirrored azimuthal angle A2 if the left and right signals are reversed.
In the terms usual in the binaural art, it is said that sound directions are ipsilateral (i.e. near-side; louder) or contralateral (i.e. far-side; quieter) with respect to a single ear; equilateral directions such as front, top, rear, and bottom are said to lie in the median plane. In a preferred embodiment of the present invention, preprocessed versions are generated and stored as single ipsilateral, contralateral, or median-plane signals rather than as specifically left- or right-ear signals. On playback, the apparatus of the PLAYBACK MEANS determines from the desired direction how to apply the ipsilateral, contralateral, and median-plane signals appropriately to the listener's left and right ears. Thus in the said embodiment the redundant storage of mirror-image data is avoided and half the number of preprocessed signals are required.
In the said preferred embodiment of the invention, the three examples given above could then be redefined as follows: for the first example covering the whole sphere, the six preprocessed versions, each now comprising only one binaural signal rather than two, would consist of front; ipsilateral; rear; contralateral; top; bottom. FIG. 3 illustrates the arrangement of preprocessing means to generate the said six preprocessed versions. The second example, covering the forward horizontal plane, would consist of contralateral; front; ipsilateral. Similarly the third example, covering the upper hemisphere, would consist of front; ipsilateral; rear; contralateral; top.
Preprocessed versions could be processed and stored for eventual playback in various ways depending on the embodiment of the present invention. When the preprocessing and playback hardware are typical of the digital audio art, for example, the preprocessor would usually be a program running in a small computer, reading, convolving, and outputting digitized sound data read from the computer's memory or disk. The respective preprocessed versions generated by the preprocessor program in this example might be stored together in memory or disk with their respective sound data samples presented sequentially or interleaved according to the hardware implementation of the PLAYBACK MEANS. In an embodiment of the invention relating to the analog audio art, the preprocessed versions could be created on tape or another analog storage medium either by transferring digitally preprocessed versions or by analog recording using a positionable kunstkopf to directly record the preprocessed versions at the desired spherical directions. Such an analog embodiment could be useful in, for example, toys where digital technology may be too costly.
Useful processes from areas of the audio art not necessarily related to the binaural art, for example equalization, surround-sound processing, or crosstalk cancellation processing for improved playback through loudspeakers, could be incorporated in the PREPROCESSING MEANS within the scope of the present invention.
The PLAYBACK MEANS described in the present invention includes two principal components: a mixing apparatus and a spherical position interpreting means which controls the mixing apparatus so as to produce the desired output during playback. The functional arrangement of these components in an example with six preprocessed versions is shown schematically in FIG. 4.
The mixing apparatus would usually be of the type familiar in the audio art where a multiplicity of sounds, or audio streams, may be synchronously played back while being individually controlled as to volume and routing so as to produce a left-right pair of output signals which combine the thusly controlled and routed multiplicity of audio streams. One such mixing apparatus comprises a general-purpose CPU running a mixing program wherein digital samples corresponding to each sound stream are successively read, scaled as to loudness and routing according to the mix instructions, summed, and then transmitted to the digital-to-analog converter (DAC) appropriate to the desired left or right output. In a more specialized apparatus, "sampler" circuits perform similar functions where a large number of sampled signals, typically short digitized samples of the sounds of particular musical instruments, are played back simultaneously as multiple musical "voices"; sampler circuits often include associated memory dedicated to the storage of samples.
According to the present invention, one of the independently volume-and routing-controllable playback streams, or voices, of the mixing apparatus is used for for each preprocessed version created by the PREPROCESSING MEANS. Thus in the example from the preceding section where the six preprocessed versions covering the whole sphere are signals for the front, ipsilateral, rear, contralateral, top, and bottom, one voice is used for each signal making a total of six voices. Other examples could typically require from three to six voices.
The volume and routing controlling parameters for the said independently volume- and routing- controllable playback streams are derived from the position control commands received by the spherical position interpreting means in the following manner, using for reference the six-voice preferred embodiment covering the whole sphere referred to in the preceding paragraph:
The following simple rule set is used for routing the six voices, noting that the routing function is independent of volume control.
1. Median plane signals, i.e. front, top, rear, and bottom, are always routed equally to left and right outputs. Only their volume is adjustable.
2. Where azimuth is between 0° and 180°, the ipsilateral signal is routed to the right ear and the contralateral signal is routed to the left ear.
3. Where azimuth is between 180° and 360°, the ipsilateral signal is routed to the left ear and the contralateral signal is routed to the right ear.
Regarding volume control parameters for the respective signals, first consider the instance where the azimuth angle is changed but elevation remains at 0°. Throughout this instance the volume of the top and bottom voice volume settings remain at zero. The mixer volume control values derived from azimuth cause the front voice to be at full volume when azimuth is 0° and the sound is straight ahead. The ipsilateral, contralateral, and rear signals are set at zero volume. Since the sound is in the median plane the front voice is routed at full volume to both ears. When the azimuth is 90°, the front and rear voices are at zero volume and both the ipsilateral and contralateral signals are at full volume. Since a sound angle of 90° lies closer to the right ear, the ipsilateral signal is routed to the right output and the contralateral signal is routed to the left output. At a sound angle of 180° the ipsilateral, contralateral, and front signals are all at zero; the rear signal is presented at full volume to both ears. At 270° azimuth, the presentation is similar to 90° azimuth except that the ipsilateral signal is routed to the left ear and the contralateral signal to the right ear.
Intermediate angles, i.e. angles not exactly at the 90° increments of the preprocessed versions, are created by setting the relevant volumes linearly in proportion to angular position within the respective 90° sector. For instance, an angle of 45°, halfway between 0° and 90°, is achieved by setting the front, near-ear, and far-ear volumes all at 45/90 or 50% volume. An angle of 10° requires settings of 80/90 or about 89% of full volume for the front and 10/90 or about 11% of full volume for the ipsilateral and contralateral voices. An angle of 255°, or 75° within the sector between 180° and 270°, requires settings of 15/90 or 17% of full volume for the rear voice and 75/90 or 83% of full volume for the ipsilateral and contralateral voices. FIG. 5 shows a tabulated chart of azimuth angles with their respective routing and volume setting values as they apply to left and right outputs.
It is possible to resolve angles depending on the volume setting resolution of the mixing apparatus; if the mixing apparatus can resolve 512 discrete levels of volume, for example, each 90° quadrant can be resolved into 512 angular steps so that the angular resolution is 90/512 or about 0.176 degree. A mixing apparatus which can resolve 16 levels of volume would have an angular resolution of 90/16 or about 5.6°.
When the elevation angle is not zero, i.e. the sound moves above or below the horizontal plane, the volume and routing settings are derived as described above and an additional operation is added. The four already-derived horizontal-plane volume settings are attenuated proportional to absolute elevation angle, i.e. they linearly diminish to zero volume at +90° or -90° elevation. Simultaneously, the signal for the top preprocessed version or the bottom preprocessed version, depending on whether elevation is positive or negative, is increased linearly proportional to the absolute elevation. Thus at the top position (elevation 90°), for example, the top signal is routed at full volume to both ears according to the mixing rule set.
Distance control may be added in a final step after the mix volume settings are complete as described above; in one example, it would be set by modifying the left and right output volumes according to the usual natural physical model of inverse-radius-squared, i.e. with loudness inversely proportional to the square of the distance to the object. It is known to those skilled in the spatial hearing art that distance perception can be subjective; accordingly it may be desirable to use different models for deriving distance in various uses of the present patent.
The playback apparatus could include additional controllable effects which need not be related to the binaural art, in particular pitch shifting in which the played back sound is controllably shifted to a higher or lower pitch while maintaining the desired spatial direction or motion in accordance with the principles of the present invention. This feature would be particularly useful, for example, to convey the Doppler shift phenomenon common to fast-moving sound sources.
In a sufficiently powerful embodiment of the present invention including, for example, one or more musical sampler circuits, the mixing apparatus and spherical position interpreting means could be applied to independently position a multiplicity of sounds at the same time. For example, one typical sampler circuit with 24 voices could independently position four sounds where each sound comprises six preprocessed versions in accordance with the specification of the invention. In a system with a multiplicity of voices it may be desirable to perform sound positioning in some of the voices while reserving other voices for other operations.
At any moment during the playback of one positioned sound by the present invention, no more than four voices need to be active, i.e. in use at more than a zero volume. This occurs because the preprocessed versions opposite the sound's angular direction are silent; they are not required as part of the output signal. Accordingly it is possible by using a more complex route switching function to free momentarily silent voices for other uses and to use a maximum of four, rather than six, voices for each positioned sound.
In the spatial sound art, sound position is usually expressed as azimuth, elevation, and distance as illustrated in FIG. 1. Obviously positioning values could be specified in other coordinate systems, Cartesian x,y, and z values for example, could be used within the scope of the present invention.
There has thus been disclosed a sound positioning apparatus comprising means of playing back sounds with three-dimensional spatial position responsively controllable in real time and means of preprocessing the said sounds so they can be spatially positioned by the said playback means.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4893342 *||15 Oct 1987||9 Jan 1990||Cooper Duane H||Head diffraction compensated stereo system|
|US5046097 *||2 Sep 1988||3 Sep 1991||Qsound Ltd.||Sound imaging process|
|US5105462 *||2 May 1991||14 Apr 1992||Qsound Ltd.||Sound imaging method and apparatus|
|US5333200 *||3 Aug 1992||26 Jul 1994||Cooper Duane H||Head diffraction compensated stereo system with loud speaker array|
|US5371799 *||1 Jun 1993||6 Dec 1994||Qsound Labs, Inc.||Stereo headphone sound source localization system|
|US5404406 *||30 Nov 1993||4 Apr 1995||Victor Company Of Japan, Ltd.||Method for controlling localization of sound image|
|US5438623 *||4 Oct 1993||1 Aug 1995||The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration||Multi-channel spatialization system for audio signals|
|US5440639 *||13 Oct 1993||8 Aug 1995||Yamaha Corporation||Sound localization control apparatus|
|US5459790 *||8 Mar 1994||17 Oct 1995||Sonics Associates, Ltd.||Personal sound system with virtually positioned lateral speakers|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5715412 *||18 Dec 1995||3 Feb 1998||Hitachi, Ltd.||Method of acoustically expressing image information|
|US5742689 *||4 Jan 1996||21 Apr 1998||Virtual Listening Systems, Inc.||Method and device for processing a multichannel signal for use with a headphone|
|US5768393 *||7 Nov 1995||16 Jun 1998||Yamaha Corporation||Three-dimensional sound system|
|US5850455 *||18 Jun 1996||15 Dec 1998||Extreme Audio Reality, Inc.||Discrete dynamic positioning of audio signals in a 360° environment|
|US5852800 *||20 Oct 1995||22 Dec 1998||Liquid Audio, Inc.||Method and apparatus for user controlled modulation and mixing of digitally stored compressed data|
|US5862227 *||24 Aug 1995||19 Jan 1999||Adaptive Audio Limited||Sound recording and reproduction systems|
|US5943427 *||21 Apr 1995||24 Aug 1999||Creative Technology Ltd.||Method and apparatus for three dimensional audio spatialization|
|US5979586 *||4 Feb 1998||9 Nov 1999||Automotive Systems Laboratory, Inc.||Vehicle collision warning system|
|US6011851 *||23 Jun 1997||4 Jan 2000||Cisco Technology, Inc.||Spatial audio processing method and apparatus for context switching between telephony applications|
|US6038330 *||20 Feb 1998||14 Mar 2000||Meucci, Jr.; Robert James||Virtual sound headset and method for simulating spatial sound|
|US6078669 *||14 Jul 1997||20 Jun 2000||Euphonics, Incorporated||Audio spatial localization apparatus and methods|
|US6111958 *||21 Mar 1997||29 Aug 2000||Euphonics, Incorporated||Audio spatial enhancement apparatus and methods|
|US6118875 *||27 Feb 1995||12 Sep 2000||Moeller; Henrik||Binaural synthesis, head-related transfer functions, and uses thereof|
|US6154549 *||2 May 1997||28 Nov 2000||Extreme Audio Reality, Inc.||Method and apparatus for providing sound in a spatial environment|
|US6178250||5 Oct 1998||23 Jan 2001||The United States Of America As Represented By The Secretary Of The Air Force||Acoustic point source|
|US6307941||15 Jul 1997||23 Oct 2001||Desper Products, Inc.||System and method for localization of virtual sound|
|US6366679||4 Nov 1997||2 Apr 2002||Deutsche Telekom Ag||Multi-channel sound transmission method|
|US6442277 *||19 Nov 1999||27 Aug 2002||Texas Instruments Incorporated||Method and apparatus for loudspeaker presentation for positional 3D sound|
|US6850496||9 Jun 2000||1 Feb 2005||Cisco Technology, Inc.||Virtual conference room for voice conferencing|
|US6956955||6 Aug 2001||18 Oct 2005||The United States Of America As Represented By The Secretary Of The Air Force||Speech-based auditory distance display|
|US7113609||4 Jun 1999||26 Sep 2006||Zoran Corporation||Virtual multichannel speaker system|
|US7130430||18 Dec 2001||31 Oct 2006||Milsap Jeffrey P||Phased array sound system|
|US7167567 *||11 Dec 1998||23 Jan 2007||Creative Technology Ltd||Method of processing an audio signal|
|US7231054||24 Sep 1999||12 Jun 2007||Creative Technology Ltd||Method and apparatus for three-dimensional audio display|
|US7308325 *||29 Jan 2002||11 Dec 2007||Hewlett-Packard Development Company, L.P.||Audio system|
|US7369665||23 Aug 2000||6 May 2008||Nintendo Co., Ltd.||Method and apparatus for mixing sound signals|
|US7391877||30 Mar 2007||24 Jun 2008||United States Of America As Represented By The Secretary Of The Air Force||Spatial processor for enhanced performance in multi-talker speech displays|
|US7572971||3 Nov 2006||11 Aug 2009||Verax Technologies Inc.||Sound system and method for creating a sound event based on a modeled sound field|
|US7602921 *||17 Jul 2002||13 Oct 2009||Panasonic Corporation||Sound image localizer|
|US7636448||28 Oct 2005||22 Dec 2009||Verax Technologies, Inc.||System and method for generating sound events|
|US7676047||7 Mar 2003||9 Mar 2010||Bose Corporation||Electroacoustical transducing with low frequency augmenting devices|
|US7818077 *||6 May 2004||19 Oct 2010||Valve Corporation||Encoding spatial data in a multi-channel sound file for an object in a virtual environment|
|US7885396||23 Jun 2005||8 Feb 2011||Cisco Technology, Inc.||Multiple simultaneously active telephone calls|
|US7953236 *||6 May 2005||31 May 2011||Microsoft Corporation||Audio user interface (UI) for previewing and selecting audio streams using 3D positional audio techniques|
|US7994412||18 May 2005||9 Aug 2011||Verax Technologies Inc.||Sound system and method for creating a sound event based on a modeled sound field|
|US8139797||18 Aug 2003||20 Mar 2012||Bose Corporation||Directional electroacoustical transducing|
|US8170245||23 Aug 2006||1 May 2012||Csr Technology Inc.||Virtual multichannel speaker system|
|US8238578||8 Jan 2010||7 Aug 2012||Bose Corporation||Electroacoustical transducing with low frequency augmenting devices|
|US8422693||29 Sep 2004||16 Apr 2013||Hrl Laboratories, Llc||Geo-coded spatialized audio in vehicles|
|US8467552 *||17 Sep 2004||18 Jun 2013||Lsi Corporation||Asymmetric HRTF/ITD storage for 3D sound positioning|
|US8520858||21 Apr 2006||27 Aug 2013||Verax Technologies, Inc.||Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources|
|US8838384||12 Mar 2013||16 Sep 2014||Hrl Laboratories, Llc||Method and apparatus for sharing geographically significant information|
|US9197977 *||3 Mar 2008||24 Nov 2015||Genaudio, Inc.||Audio spatialization and environment simulation|
|US20020111705 *||29 Jan 2002||15 Aug 2002||Hewlett-Packard Company||Audio System|
|US20030141967 *||17 Dec 2002||31 Jul 2003||Isao Aichi||Automobile alarm system|
|US20030185404 *||18 Dec 2001||2 Oct 2003||Milsap Jeffrey P.||Phased array sound system|
|US20030202665 *||24 Apr 2002||30 Oct 2003||Bo-Ting Lin||Implementation method of 3D audio|
|US20040105550 *||3 Dec 2002||3 Jun 2004||Aylward J. Richard||Directional electroacoustical transducing|
|US20040105559 *||7 Mar 2003||3 Jun 2004||Aylward J. Richard||Electroacoustical transducing with low frequency augmenting devices|
|US20040196982 *||18 Aug 2003||7 Oct 2004||Aylward J. Richard||Directional electroacoustical transducing|
|US20040196991 *||17 Jul 2002||7 Oct 2004||Kazuhiro Iida||Sound image localizer|
|US20040247144 *||27 Sep 2002||9 Dec 2004||Nelson Philip Arthur||Sound reproduction systems|
|US20050129256 *||3 Feb 2005||16 Jun 2005||Metcalf Randall B.||Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources|
|US20050222841 *||16 May 2005||6 Oct 2005||Digital Theater Systems, Inc.||System and method for providing interactive audio in a multi-channel audio environment|
|US20050249367 *||6 May 2004||10 Nov 2005||Valve Corporation||Encoding spatial data in a multi-channel sound file for an object in a virtual environment|
|US20060062409 *||17 Sep 2004||23 Mar 2006||Ben Sferrazza||Asymmetric HRTF/ITD storage for 3D sound positioning|
|US20060109988 *||28 Oct 2005||25 May 2006||Metcalf Randall B||System and method for generating sound events|
|US20060206221 *||22 Feb 2006||14 Sep 2006||Metcalf Randall B||System and method for formatting multimode sound content and metadata|
|US20060251263 *||6 May 2005||9 Nov 2006||Microsoft Corporation||Audio user interface (UI) for previewing and selecting audio streams using 3D positional audio techniques|
|US20060262948 *||21 Apr 2006||23 Nov 2006||Metcalf Randall B||Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources|
|US20060280323 *||23 Aug 2006||14 Dec 2006||Neidich Michael I||Virtual Multichannel Speaker System|
|US20070003044 *||23 Jun 2005||4 Jan 2007||Cisco Technology, Inc.||Multiple simultaneously active telephone calls|
|US20070056434 *||3 Nov 2006||15 Mar 2007||Verax Technologies Inc.||Sound system and method for creating a sound event based on a modeled sound field|
|US20070160218 *||17 Jan 2006||12 Jul 2007||Nokia Corporation||Decoding of binaural audio signals|
|US20070160219 *||13 Feb 2006||12 Jul 2007||Nokia Corporation||Decoding of binaural audio signals|
|US20070297624 *||25 May 2007||27 Dec 2007||Surroundphones Holdings, Inc.||Digital audio encoding|
|US20080056517 *||27 Aug 2007||6 Mar 2008||The Regents Of The University Of California||Dynamic binaural sound capture and reproduction in focued or frontal applications|
|US20090046864 *||3 Mar 2008||19 Feb 2009||Genaudio, Inc.||Audio spatialization and environment simulation|
|US20100119081 *||8 Jan 2010||13 May 2010||Aylward J Richard||Electroacoustical transducing with low frequency augmenting devices|
|US20100215195 *||21 May 2008||26 Aug 2010||Koninklijke Philips Electronics N.V.||Device for and a method of processing audio data|
|US20100223552 *||2 Mar 2009||2 Sep 2010||Metcalf Randall B||Playback Device For Generating Sound Events|
|USRE44611||30 Oct 2009||26 Nov 2013||Verax Technologies Inc.||System and method for integral transference of acoustical events|
|DE19645867A1 *||7 Nov 1996||14 May 1998||Deutsche Telekom Ag||Multiple channel sound transmission method|
|WO1998033357A2 *||22 Jan 1998||30 Jul 1998||Sony Pictures Entertainment||Method and apparatus for electronically embedding directional cues in two channels of sound for interactive applications|
|WO1998033676A1||5 Feb 1998||6 Aug 1998||Automotive Systems Lab||Vehicle collision warning system|
|WO1999031938A1 *||11 Dec 1998||24 Jun 1999||Central Research Lab Ltd||A method of processing an audio signal|
|WO2006050353A2 *||28 Oct 2005||11 May 2006||Randall B Metcalf||A system and method for generating sound events|
|WO2007080224A1 *||4 Jan 2007||19 Jul 2007||Nokia Corp||Decoding of binaural audio signals|
|U.S. Classification||381/17, 381/26, 381/309|
|Cooperative Classification||H04S1/005, H04S1/002|
|13 Apr 1998||AS||Assignment|
Owner name: FOCAL POINT, LLC, NEW HAMPSHIRE
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GEHRING, LOUIS S.;REEL/FRAME:009114/0477
Effective date: 19980402
|22 Nov 1999||FPAY||Fee payment|
Year of fee payment: 4
|17 Dec 2003||REMI||Maintenance fee reminder mailed|
|28 May 2004||LAPS||Lapse for failure to pay maintenance fees|
|27 Jul 2004||FP||Expired due to failure to pay maintenance fee|
Effective date: 20040528