Editor

/home/code/dissertation

Title	Dissertation
Description	Objective Analysis of Time Stretching Algorithms
Keywords	cooper baker, cooper, baker, cooperbaker, dissertation, ucsd, phd, doctor, time, stretch, stretching, algorithm, dsp, phase, vocoder, pvoc, grain, granular, spectrum, spectral, compare, comparison, evaluate, evaluation, matlab, math, code, oscillator bank, phase, lock, peak, track, locked, tracking, locking, tracked, synchronous, overlap, add, sola, ola, fast, fourier, transform, discrete, fft, dft, analysis, analyze, music, musical, musician, digital, signal, processing, amazing
Content	<center> <h2>Objective Analysis<br>of<br>Time Stretching Algorithms</h2> </center> <?php ruler( 'Abstract' ); ?> <?php dropIcon(); ?> This research describes and implements new techniques for objective analysis and comparison of common time stretching algorithms. A set of test signals and samples is used in conjunction with spectral analysis to generate objective error measurements and subsequent comparisions of the algorithms. The time stretching techniques are treated as black-box processes, and are regarded as members within a general family of analyze-modify-resynthesize algorithms. This black-box approach of output signal analysis provides a basis for objective evaluation of the more general class of algorithms. Six common time stretching algorithms are analyzed: the classic phase vocoder, oscillator bank phase vocoder, peak tracking phase vocoder, phase-locked vocoder, synchronous overlap add technique, and overlap add technique. The six algorithms are then compared within a uniform framework to provide greater insight regarding the behavior of their output signals. Subjective listening evaluations are also performed, then all results contribute to the development of criteria that evaluate and rank the algorithms’ suitability in various signal processing situations. <br> <br> <?php ruler( 'Download' ); ?> <?php download( 'Objective Analysis of Time Stretching Algorithms.pdf', 'Objective Analysis of Time Stretching Algorithms.pdf' ); ?> <br> <br> <?php ruler( 'Resources' ); ?> <style> td { vertical-align: top; } </style> <table border="0"> <tr> <td> • <a href="audio">Audio</a> </td> <td> – browse audio files </td> </tr> <tr> <td> • <?php download( '../audio/files/Audio.zip', 'Audio.zip' ); ?> </td> <td> – download audio files </td> </tr> <tr><td colspan="2" style="height: 0.5em;"></td></tr> <tr> <td> • <a href="graphs">Graphs</a> </td> <td> – browse graphs </td> </tr> <tr> <td> • <?php download( '../graphs/files/Graphs.zip', 'Graphs.zip' ); ?> </td> <td> – download graphs </td> </tr> <tr><td colspan="2" style="height: 0.5em;"></td></tr> <tr> <td> • <a href="scripts">Scripts</a> </td> <td> – browse scripts </td> </tr> <tr> <td> • <?php download( '../scripts/display/files/Scripts.zip', 'Scripts.zip' ); ?> </td> <td> – download scripts </td> </tr> <tr><td colspan="2" style="height: 0.5em;"></td></tr> <tr> <td> • <?php download( 'All.zip', 'All.zip' ); ?> </td> <td> – download all resources </td> </tr> </table> <br> <?php ruler( 'Citations' ); ?> <table cellspacing="10" cellpadding="0" border="0"> <tr> <td align="right"> M.L.A. </td> <td> — </td> <td>Baker, Cooper Everett. Objective Analysis of Time Stretching Algorithms. <br> Diss. University of California, San Diego, 2015. </td> </tr> <tr> <td align="right"> A.P.A. </td> <td> — </td> <td>Baker, C. E. (2015). Objective Analysis of Time Stretching Algorithms <br> (Doctoral dissertation, University of California, San Diego). </td> </tr> <tr> <td align="right"> Chicago </td> <td> — </td> <td>Baker, Cooper Everett. Objective Analysis of Time Stretching Algorithms. <br> Diss. University of California, San Diego, 2015. </td> </tr> <tr> <td align="right"> ProQuest </td> <td> — </td> <td><?php href( 'http://gradworks.umi.com/37/04/3704219.html', 'http://gradworks.umi.com/37/04/3704219.html' ); ?> </td> </tr> </table> <br> <?php ruler( 'Analysis Example' ); ?> In total, this research uses six test signals in conjunction with three analysis techniques to evaluate six time stretching algorithms. The techniques and algorithms are described in detail, and 128 different graphs representing the resultant data are interpreted and comparatively discussed. This particular example was selected to briefly illustrate a facet of the research and provide a general idea of what the work is about. <br> <br> <strong>1 — Test Signal</strong> <br> <br> Analysis of the Phase-Locked Vocoder in this example is performed using one of the special test signals shown below. This test signal is designed to be difficult to stretch, and consists of a steady 1000 Hertz sinusoid mixed with a logarithmically swept sinusoid that moves from 50 to 21,000 Hertz. <br> <br> <?php photo( 'example/images/sweep.jpg' ); ?> <center> <i>Test Signal</i> </center> <br> The input signal is synthesized with a duration of two seconds and an another ideal output signal is synthesized with a duration of four seconds. This allows comparison of the ideal output signal with the stretched output signal when the Phase-Locked Vocoder is configured to stretch its input by two times. The input, ideal, and stretched signals used in this example may be heard below. <br> <br> <?php audio( 'example/audio/original.wav' ); ?> <center> <i>Input Signal</i> </center> <br> <?php audio( 'example/audio/ideal.wav' ); ?> <center> <i>Ideal Output Signal</i> </center> <br> <?php audio( 'example/audio/lock.wav' ); ?> <center> <i>Stretched Output Signal</i> </center> <br> <br> <strong>2 — Phase-Locked Vocoder</strong> <br> <br> Time stretching of the input signal is performed by the Phase-Locked Vocoder developed by Miller Puckette. This algorithm is similar to the Classic Phase Vocoder, however, it produces higher fidilety results by mitigating phase errors with a technique that locks phases of adjacent bins together before resynthesis. The following formulas show its operation, starting with a Discrete Fourier Transform (DFT) that generates spectral data where <i>X</i> contains the spectra, <i>w</i> is the window function, <i>x</i> is the signal, <i>H</i> is the hop size in samples, <i>S</i> is the stretch factor, <i>N</i> is the window size in samples, and <i>F</i> is the number of frames: <br> <br> <?php image( 'example/svg/pvoc/fft.svg', '700px' ); ?> <br> Phase accumulation occurs next, where <i>P</i> contains accumulated phase, <i>over-bar</i> signifies the complex conjugate, and <i>Y[f-1,k]</i> represents the previous output spectrum: <br> <br> <?php image( 'example/svg/pvoc/phase_accum.svg', '700px' ); ?> <br> Following phase accumulation, phases are locked together into <i>L</i>, with the notation <i>k-1</i> and <i>k+1</i> signifying bin offsets, so that phases of three adjacent bins are combined: <br> <br> <?php image( 'example/svg/pvoc/phase_lock.svg', '700px' ); ?> <br> After adjacent phases are combined, the output spectra are calculated as <i>Y</i>: <br> <br> <?php image( 'example/svg/pvoc/out_spect.svg', '700px' ); ?> <br> Finally, the output signal is windowed and overlap-added into <i>y</i>: <br> <br> <?php image( 'example/svg/pvoc/ifft.svg', '700px' ); ?> <br> <br> <strong>3 — Moving Spectral Analysis</strong> <br> <br> Moving Spectral Analysis was developed for this research to provide information about the behavior of a stretched signal over time. This technique affords insight about time domain features like transients or persistent amplitude modulations by comparing them to their counterparts in the ideal signal. In order to create meaningful comparisons, the signals are power-normalized according to the following equations, where <i>x</i> is the audio file, <i>w</i> is the windowing function, <i>A</i> is the start of the signal region, <i>B</i> is the end of the signal region, and <i>R</i> is the Root Mean Square (RMS) power value: <br> <br> <?php image( 'example/svg/norm/rms.svg', '700px' ); ?> <br> <i>R</i> is then used to perform power-normalization of the stretched file so that it matches the ideal file as shown by the following equation, where <i>x<sub>s</sub></i> is the stretched file, <i>R<sub>s</sub></i> is the stretched RMS power value, <i>R<sub>i</sub></i> is the ideal RMS power value, <i>x<sub>sr</sub></i> is the power-normalized stretched file, and <i>N</i> is the length of the file in samples: <br> <br> <?php image( 'example/svg/norm/norm.svg', '700px' ); ?> <br> Following normalization, Fourier analysis is used to compare the signals’ spectra, frame by frame, to create a measure of difference between the ideal and stretched versions. The first step is implemented with a DFT where <i>X</i> represents the output spectrum, <i>N</i> is the number of samples per analysis frame, <i>w</i> is the window function, <i>x</i> is the signal, <i>H</i> is the hop size in samples, and <i>F</i> is the total number of frames: <br> <br> <?php image( 'example/svg/mov/fft.svg', '700px' ); ?> <br> The next step is the calculation of a set of moving average magnitude values over time, or magnitude curve, according to the following equation, where <i>M</i> contains the magnitude curve: <br> <br> <?php image( 'example/svg/mov/mag_avg.svg', '700px' ); ?> <br> The windowing function is then normalized out of the magnitude curve, and the magnitude curve is converted to sones as represented by <i>S</i>, shown here by the following equation: <br> <br> <?php image( 'example/svg/mov/sones_avg.svg', '700px' ); ?> <br> After creating the sones curves in <i>S</i>, the following equation uses these curves to calculate an error curve that shows how the two signals differ. <i>E</i> represents the error curve, <i>X<sub>i</sub></i> is the ideal spectrum, and <i>X<sub>s</sub></i> is the stretched spectrum: <br> <br> <?php image( 'example/svg/mov/error.svg', '700px' ); ?> <br> Finally, the average and maximum error values are determined according to the following equations, where <i>E<sub>avg</sub></i> is the average value of the error spectrum, and <i>E<sub>max</sub></i> is the maximum value of the error spectrum: <br> <br> <?php image( 'example/svg/mov/avg.svg', '700px' ); ?> <?php image( 'example/svg/mov/max.svg', '700px' ); ?> <br> <strong>4 — Analysis Graphs</strong> <br> <br> The following graphs show the ideal swept sinusoid signal in blue, the stretched version in green, and the error, or absolute difference, in red. Error is scaled in sones on the Y axis to more closely match our perception of sound, and the X axis displays the ideal and stretched signals over time, while also providing a more analytical representation of their differences than our ears can perceive. The upper graph is an overview of the entire signals, and the lower graphs show more detailed views of interesting areas within the signals. <br> <br> <?php photo( 'example/images/mov_lock.jpg' ); ?> <center> <i>Moving Spectral Analysis Graphs</i> </center> <br> <br>
	1 : 1