Project

Description

Video

The Orchive, one of the largest repositories of bioacoustic data in the world, containing over 30,000 hours of recordings of orca vocalizations, collected from OrcaLab, a land-based research station at Hanson Island on the BC coast.

Download Paper

Chant and cantillation research is particularly interesting as it explores the transition from oral to written transmission of music. The goal of this work to create web-based computational tools that can assist the study of how diverserecitation traditions, having their origin in primarily non-notated melodies, later became codifed.

Download Paper

Audioscapes is a framework for prototyping and exploring how touch-based and gestural controllers can be used with state-of-the-art content and context-aware visualizations. By providing well-defined interfaces and conventions a variety of different audio collections, controllers and visualization methods can be combined to create innovative ways of interacting with large audio collections.

Download Paper

Panning Pedagogy

pan.sness.net
code

Panning Pedagogy is an online Flash application to help teach students in record production learn where different sounds in a mix are panned to in the left/right stereo space.

Download Paper

kidrideshare.com

A solution for a project in Computer Supported Collaborative Work for parents with kids that need a web based ride sharing tool. This tool is built in Ruby on Rails and allows the parents to mark their availablity on a calendar, and to mark when they have kids to be picked up. It then finds the best route using Google Maps to ensure all the kids get picked up.

Self-Organising Tag Clouds

playtagnow.sness.net
code

In this paper we examine the utility and engageability of placing similar tags next to each other. In order to determine similarity of tags we use a self-organizing map based on acoustical features derived from songs rather than using the more common tag co-occurrence to measure similarity. To evaluate the proposed approach a subset of the Magnatune database tagged using the Targeting game-with-a-purpose was utilized. Experimental results showing that using a self-organizing tag cloud is both faster and more fun are presented.

Sonophenology

code

Phenology is the study of the timing of biological processes -- for example, when do the cherry blossoms flower in the springtime. Sonophenology is a program that uses a tangible interface to allow users to explore phenology datasets by representing this data as notes on a pentatonic scale.

Download Paper

We describe how stacked generalization can be used to improve the performance of a state-of-the-art automatic tag annotation system for music based on audio content analysis and report results on two publicly available datasets

Download Paper

dZ

code

A performance of my piece "dZ" at the University of Victoria using a combination of acoustic drums and the radiodrum, a 3d position sensor with such high temporal accuracy that it can act like a drum. The system uses a number of different components, including Ableton Live, MaxMSP and Marsyas. For the section with the words, the sounds were mapped onto the surface of the radiodrum using a Self-Organising Map (SOM), a neural-network based technique that takes complex audio feature vectors, and maps them onto a two dimensional grid. This is the first performance of the new radiodrum, a new rethinking of Max Matthew's original radiodrum instrument designed by its original creator Bob Boie.