Listening to ''sound sketches''

What is it?

Image Blurring
Left photograph courtsey: Ben Heine, an amazing artist-cum-photographer. A good sketch of an image uses curves intelligently. What about sketch of a sound?

This page presents some sound samples of simple "sound sketches". These sketches are computationally inexpensive to obtain. The idea behind some of these was conceived in mid 20th century while exploring the intelligibility information in speech signals. Here, we knit them and some new ones under the category of "sound sketches". While computationally these are cheap to obtain, we leave the perceptual judgement on what they preserve on you.

So, whats' below?

Below are a list of sound files. To get a better understanding of sketches, and appreciate their perceptual beauty!, we suggest:

  1. Hear the sketches first, and hear each repeatedly (may be twice or thrice). Try to make out the spoken words. Some files may have other distortions, but over repreated hearing you will start neglecting them.
  2. Listen the clean sound file but only after you have badly failed to understand anything from the sound sketch.
  3. Go back and again listen to the sound sketch. You will likely understand the sketch better now.
Consider x[n] as the clean signal. Sketches, denoting by y[n], in the table include:
    Preserving zero-crossing time instants/fine-temporal structure:
  • Infinite clipping (Licklider, 1948): This is analogous to preserving only the polarity of the sample. In short, y[n] = signum(x[n]).
  • Diff-Infinite clipped (Licklider, 1948): In short, y[n] = signum(diff(x[n])).
  • Analytic phase sinusoid: In short, y[n] = sin(angle(analytic(x[n]))).
    Preserving temporal envelope structure:
  • Envelope only: In short, y[n] = abs(analytic(x[n])).
  • Diff-envelope only: In short, y[n] = diff(abs(analytic(x[n]))).
  • Envelope on a tone: In short, y[n] = abs(analytic(x[n]))*sin(2*pi*f0*nTs), f0 = 500 Hz.
  • Diff-envelope only: In short, y[n] = diff(abs(analytic(x[n])))*sin(2*pi*f0*nTs), f0 = 500 Hz.
    Preserving Long-time spectrum/phase structure (Oppenheim, 1981):
  • Long-time Fouruer transform magnitude only
  • Long-time Fouruer transform phase only
    Preserving Short-time spectrum/phase structure (Wang, and Lim, 1982 ):
  • Short-time Fouruer transform magnitude only
  • Short-time Fouruer transform phase only
    Preserving gross spectral structure:
  • Sine-wave speech (SWS, Remez, and Rubin, 1980): Express speech as sum of sinusoids parametrized by time-varying formant frequencies and amplitude.
  • Block sampling SWS (Insights from C. Darwin's findings, 2002s): Interrupt the continuous SWS at a specific uniform rate.
  • LPC spectral envelope: Excite the linear prediction spectral envelope by noise.


=======================================
Advise: Do have control on your sound button.
=======================================

  1. Speech:
      Male (Hindi) See more.

      Hide this content.

      ==== Male Speech (Hindi) ====
      Clean download

      play here


    • 1.a. Infinite clipped. download

      play here
    • --------
    • 1.b. Diff-Infinite clipped. download

      play here
    • --------
    • 1.c. Analytic phase sinusoid. download

      play here
    • --------
    • 1.d. Envelope only. download

      play here
    • --------
    • 1.e. Diff. envelope only.. download

      play here
    • --------
    • 1.f. Envelope on a tone. download

      play here
    • --------
    • 1.g. Diff. envelope on a tone. download

      play here
    • --------
    • 1.h. Long-time Fourier Transform magnitude only. download

      play here
    • --------
    • 1.i. Long-tme Fourier transform phase only. download

      play here
    • --------
    • 1.j. Short-time Fourier Transform magnitude only. download

      play here
    • --------
    • 1.k. Short-time Fourier transform phase only. download

      play here
    • --------
    • 1.l. Sine-wave Speech. download

      play here
    • --------
    • 1.m. Block sampling SWS. download

      play here
    • --------
    • 1.n. LPC Spectral envelope on noise. download

      play here
    • --------
    • Hide this content.

      Male (Odia) See more.

      Hide this content.

      ==== Male Speech (Odia) ====
      Clean download

      play here


    • 2.a. Infinite clipped. download

      play here
    • --------
    • 2.b. Diff-Infinite clipped. download

      play here
    • --------
    • 2.c. Analytic phase sinusoid. download

      play here
    • --------
    • 2.d. Envelope only. download

      play here
    • --------
    • 2.e. Diff. envelope only.. download

      play here
    • --------
    • 2.f. Envelope on a tone. download

      play here
    • --------
    • 2.g. Diff. envelope on a tone. download

      play here
    • --------
    • 2.h. Long-time Fourier Transform magnitude only. download

      play here
    • --------
    • 2.i. Long-tme Fourier transform phase only. download

      play here
    • --------
    • 2.j. Short-time Fourier Transform magnitude only. download

      play here
    • --------
    • 2.k. Short-time Fourier transform phase only. download

      play here
    • --------
    • 2.l. Sine-wave Speech. download

      play here
    • --------
    • 2.m. Block sampling SWS. download

      play here
    • --------
    • 2.n. LPC Spectral envelope on noise. download

      play here
    • --------
    • Hide this content.

      Female (English) See more.

      Hide this content.

      ==== Female Speech (English) ====
      Clean download

      play here


    • 3.a. Infinite clipped. download

      play here
    • --------
    • 3.b. Diff-Infinite clipped. download

      play here
    • --------
    • 3.c. Analytic phase sinusoid. download

      play here
    • --------
    • 3.d. Envelope only. download

      play here
    • --------
    • 3.e. Diff. envelope only.. download

      play here
    • --------
    • 3.f. Envelope on a tone. download

      play here
    • --------
    • 3.g. Diff. envelope on a tone. download

      play here
    • --------
    • 3.h. Long-time Fourier Transform magnitude only. download

      play here
    • --------
    • 3.i. Long-tme Fourier transform phase only. download

      play here
    • --------
    • 3.j. Short-time Fourier Transform magnitude only. download

      play here
    • --------
    • 3.k. Short-time Fourier transform phase only. download

      play here
    • --------
    • 3.l. Sine-wave Speech. download

      play here
    • --------
    • 3.m. Block sampling SWS. download

      play here
    • --------
    • 3.n. LPC Spectral envelope on noise. download

      play here
    • --------
    • Hide this content.

  2. ===============================
  3. Song:
      Vocal and music See more.

      Hide this content.

      ==== Hindi Song (Female+Male+Instruments) ====
      Clean download

      play here


    • 4.a. Infinite clipped. download

      play here
    • --------
    • 4.b. Diff-Infinite clipped. download

      play here
    • --------
    • 4.c. Analytic phase sinusoid. download

      play here
    • --------
    • 4.d. Envelope only. download

      play here
    • --------
    • 4.e. Diff. envelope only.. download

      play here
    • --------
    • 4.f. Envelope on a tone. download

      play here
    • --------
    • 4.g. Diff. envelope on a tone. download

      play here
    • --------
    • 4.h. Long-time Fourier Transform magnitude only. download

      play here
    • --------
    • 4.i. Long-tme Fourier transform phase only. download

      play here
    • --------
    • 4.j. Short-time Fourier Transform magnitude only. download

      play here
    • --------
    • 4.k. Short-time Fourier transform phase only. download

      play here
    • --------
    • 4.l. Sine-wave Speech. download

      play here
    • --------
    • 4.m. Block sampling SWS. download

      play here
    • --------
    • 4.n. LPC Spectral envelope on noise. download

      play here
    • --------
    • Hide this content.

  4. ===============================
  5. Music Instruments:
      Flute See more.

      Hide this content.

      ==== Flute solo ====
      Clean download

      play here


    • 5.a. Infinite clipped. download

      play here
    • --------
    • 5.b. Diff-Infinite clipped. download

      play here
    • --------
    • 5.c. Analytic phase sinusoid. download

      play here
    • --------
    • 5.d. Envelope only. download

      play here
    • --------
    • 5.e. Diff. envelope only.. download

      play here
    • --------
    • 5.f. Envelope on a tone. download

      play here
    • --------
    • 5.g. Diff. envelope on a tone. download

      play here
    • --------
    • 5.h. Long-time Fourier Transform magnitude only. download

      play here
    • --------
    • 5.i. Long-tme Fourier transform phase only. download

      play here
    • --------
    • 5.j. Short-time Fourier Transform magnitude only. download

      play here
    • --------
    • 5.k. Short-time Fourier transform phase only. download

      play here
    • --------
    • 5.l. Sine-wave Speech. download

      play here
    • --------
    • 5.m. Block sampling SWS. download

      play here
    • --------
    • 5.n. LPC Spectral envelope on noise. download

      play here
    • --------
    • Hide this content.

      Violin See more.

      Hide this content.

      ==== Violin solo ====
      Clean download

      play here


    • 6.a. Infinite clipped. download

      play here
    • --------
    • 6.b. Diff-Infinite clipped. download

      play here
    • --------
    • 6.c. Analytic phase sinusoid. download

      play here
    • --------
    • 6.d. Envelope only. download

      play here
    • --------
    • 6.e. Diff. envelope only.. download

      play here
    • --------
    • 6.f. Envelope on a tone. download

      play here
    • --------
    • 6.g. Diff. envelope on a tone. download

      play here
    • --------
    • 6.h. Long-time Fourier Transform magnitude only. download

      play here
    • --------
    • 6.i. Long-tme Fourier transform phase only. download

      play here
    • --------
    • 6.j. Short-time Fourier Transform magnitude only. download

      play here
    • --------
    • 6.k. Short-time Fourier transform phase only. download

      play here
    • --------
    • 6.l. Sine-wave Speech. download

      play here
    • --------
    • 6.m. Block sampling SWS. download

      play here
    • --------
    • 6.n. LPC Spectral envelope on noise. download

      play here
    • --------
    • Hide this content.



Having come so far,...there is more to come..