Clockwork Composer

We had an exciting day at the Museum of the History of Science in Oxford yesterday, getting people to play with our bespoke iPad Clockwork Composer.

Visitors used the special iPad interface we designed using TouchOSC to play with a musical composition made (almost) entirely from recordings of various parts of clocks - bells, chimes, springs, pendulums and that kind of thing.

The piece was composed to tie in with the museum’s special day of events, titled About Time, relating to the current temporary exhibition, Time Machines, which looks at the history of time measuring and timekeeping.

Although the entire composition was manipulated via the iPad interface, the actual sounds and effects were running off a hidden laptop, using Ableton Live.

You can watch a video of the set-up in action on the day here. We also played a bit of ropey bass guitar.

Heavy metal harmony, part 2

A few weeks ago I posted a few thoughts about our attempt to create a fascinating, engaging and entertainment science fair stall all about the science of music. It’s for a big event, called Wow! How?, which is taking place this Saturday (12 March) at the University of Oxford Museum of Natural History and Pitt Rivers Museum and is part of National Science & Engineering Week.

We had intended to reveal how musical harmony is all part and parcel of mathematical relationships and whole fractions. With the tale of Pythagoras’ observation that a blacksmith’s irons made different tones when struck, some harmonious and others not, we were going to show how things with masses or lengths that are exact fractions of one another will produce tones that are in harmony when they are struck or plucked.

But then I realised that to get to this part we first have to understand what is actually happening when we hit a piece of metal, pluck a guitar string or blow air across the reed in an oboe. We had to start with a much more fundamental question: what is sound?

So this is the new objective of our stall at Wow! How? – to explain exactly what sound is. This in itself is no mean feat, as it turns out. But to help us we have a host of fun experiments and little activities that will reveal how sound is a vibration of molecules in the air (or any gas, liquid or solid) which takes the form of a longitudinal wave. We will use an oscilloscope to show the shape of the sound waves created by a guitar or voice and a vacuum chamber to show what happens if we remove the air from around something that is making a sound.

We’ll also have an array of instruments to pluck, plonk and plink, some of our own and some from the Pitt Rivers Museum collection. And if we’re lucky we may get to talk a little bit about the mathematical beauty of musical harmony after all.

Full report here after the event.

Glitch.

There’s some amazing sound design work in “Locked in a Vegas Hotel Room with a Phantom Flex” by Tom Guilmette. The drama and mood conveyed in the audio is wondrous to behold, really supporting the visuals and adding oomph where needed. The sound takes it from an interesting series of experiments with high frame rate cameras, to an almost-art level. Great stuff.

Tapping, picking and slapping…


…are all things you can do to a guitar.


Here’s a nice post from Michael Johnson at design group Johnson Banks about the amazing guitar playing style of Andy McKee.


Above is the video that Michael links to, so you can have a quick listen (and stare!) here.


Glitch

The New York Subway in Strings.


Wonderful piece by Alexander Chen, “playing” the NYC subway alongside the classic geometric map by Massimo Vignelli.


Clever stuff too, using SVG graphics and HTML5 to produce the finished work. Audio is handled by Soundmanager, which Glitch & Drone also use on the front page of our main site. It’s really a lovely, elegant way of handling audio, though Alexander is really pushing it here!

Music, DSLR video and low light

In December, Glitch & Drone was asked to create an electronic Christmas card for commercial property web software developer Estates Today. The project threw up a few interesting considerations and useful learning experiences, so we thought we would write a little about how it came about.

Initially, although we knew that music would be a major component of the card, we still needed a concept for the presentation of the music and the accompanying message. The idea to shoot commercial property decked in Christmas trimmings, although obviously suited to the client’s business and the season, actually came about a little by accident.

Simon had been at a meeting in Bankside in London and had snapped a few images of the lights that are strung around the buildings and riverside there. Reviewing these images later, the notion of property looking good, or more importantly ‘feeling’ good, sung out. A few notebook scribbles later and the basic strapline – ‘We make property feel this good all year round’ – tied the seasonal message with the corporate property offer of Estates Today.

Images + music + strapline = nice card. Super. But in our infinite wisdom we decided that video would be more effective than stills, so we elected to return to the same location to shoot some twinkly footage. This raised a few more technical bumps to overcome and made us realise just how much of the preparation had already been achieved, however unwittingly, in those initial photos that Simon had taken. The lesson we take from this is to always carry a camera, shoot as you go and then consider whether the material or location might be developed and refined later.

The sound and music

There are actually two aspects to the sound in the finished piece. Firstly, there is the musical soundtrack itself and secondly there are ambient sounds taken from the filming locations. Some of these ambient sounds were recorded using the camera’s internal microphone, and so sync with the footage, but we also used a Zoom H2 portable mic to capture different environmental recordings. We think it is worth getting into a habit of making ambient recordings as you travel around because they can often be used as evocative textures in other pieces of sound design and music later on.

The music itself was recorded using Ableton Live 8 and is built around a simple descending phrase, played on a synthetic brass sound and overlaid with a partial major-scale arpeggio played on tinkling bells. Movement is created by an organ sound which cycles through an ascending four-chord sequence, repeating until the final strapline scene, when the music resolves into a ‘happier’ closing major chord. The bells then fade on a small portion of The First Noel over the end-card.

Overall, the effect is of a cool and electronic evocation of Christmas carols, sitting with the nightscape footage and the corporate nature of the card. The trick, we felt, was to be warm and festive without being mawkish and to be corporate without being cold and faceless.

The shoot

Aside from the fact that shooting film in winter, at night, is very cold (and in this case also wet), there are a few other technical pointers which came out of the shoot. Firstly, unless you’re absolutely familiar with your gear and how it is going to operate, take some means of assessing your footage as you go. In other words, take a laptop.

We used a Nikon D7000 to shoot the film and after an initial burst of footage we retired to the pub to see what we’d got. This pub stop was invaluable, not only for beer and warmth, but also because it immediately showed us that shooting at high ISO settings creates a fair amount of digital noise in the video. Exactly how much noise you’re prepared to tolerate probably depends on the final application of the film (and perhaps on personal preference), but we quickly worked out that any sensitivity greater than ISO 800 was just too noisy.

In low light this is an issue: underexposed film would be a real problem in the edit. So we had to ensure that ISO 800 would produce acceptable exposure at night, even if the scenes did become a little more ‘low key’. In practice, this meant we had to manually override the camera’s exposure settings (in video mode the D7000 automatically adjusts everything to expose the scene ‘correctly’) and get outside into the drizzle to shoot (or reshoot) additional footage.

The second extremely important thing that the laptop review revealed was the camera wobble being generated as we turned the focus rings. Even though the camera was mounted on a tripod, it was still not stable enough to remain stationary during refocusing. We tried extremely hard to be as delicate as possible when turning the focusing rings, but in some cases, especially when using longer focal length lenses, it was impossible to eliminate all jitter in the video. Because your final film is only as good as your best footage, every tiny wobble is a problem.

So if you are shooting footage where focus transitions will be involved – which covers pretty much everything bar static talking heads – we would recommended using a stabilizing accessory for focusing. Similarly, using the camera’s LCD screen, it is very difficult to see exactly where in the scene your point of focus is – even the larger screens are too small to be sure, especially if you are squinting at them from an awkward angle, lying on the ground to capture a low shot, for example. Accessories also cater for this, with magnifying pieces that fit over the screen to enlarge the image.

The upshot is that filmmaking is more delicate and requires more specialist equipment than most photography. No great surprise, but worth bearing in mind if you are planning to shoot a high-quality piece of video.

Glitch.

Of all the ways to lose huge amounts of money, making a prototype of your idea is one of the most effective | Insight from Roger Linn

Roger Linn, creator of Linn drums and other wondrous wizardry has posted an FAQ regarding making prototypes of your ideas for musical gadgetry. Essentially, this seems to boil down to: “Don’t Or do it on the cheap, just to prove the idea”, but there’s lots of other great advice here too.

Read Roger Linn’s article on prototyping here

Scoring an Operating System?

In a weird brand/culture tie-in, I give you the space-challenged UbuntuFreeCultureShowcase

They say:

“The Ubuntu Free Culture Showcase is an opportunity to show off high quality free culture content in Ubuntu. At the heart of Ubuntu’s ethos is a belief in showcasing free software and free culture, and with each development cycle we open the opportunity for any artist to put their work in front of millions of Ubuntu users around the world.”

Exciting stuff. I note they don’t say that all the entries have to be created in open-source software.

Heavy metal harmony

There’s a book in my little library of potentially useful books called The Physics of Music. Sadly, it’s largely impenetrable, but it has just become rather relevant because I am currently attempting to devise a public stall that will delight, engage and educate visitors on the subject of science and music.

It’s for a science jamboree that is part of National Science & Engineering Week and will take place at the University of Oxford Museum of Natural History and Pitt Rivers Museum on 12 March. It’s open to all, but has a focus around 7-14 year olds.

Because we’re interested in sound, music and science at G&D (and because I am studying a couple of related courses), this seemed like a perfect opportunity to have some fun and get people thinking about how sound works and, more importantly, why some combinations of sound are musical and others are not.

So I decided to start at the very beginning, with Pythagoras of course. Famed for his elegant description of the properties of right-angled triangles (spawning a theorem no less), Pythagoras was also interested in the musical properties of sound. The story, perhaps largely apocryphal, says that on passing a blacksmith’s workshop one day Pythagoras’ ear was caught by the sound of a hammer hitting various pieces of iron. Each made a tone and all but one of these tones appeared to bear a pleasant relation to the others. The odd one out didn’t fit – when struck by the blacksmith it sounded bad in the company of the other tones.

Curious to learn why this was the case, Pythagoras allegedly examined the mass of the different bits of iron and discovered that those that were in harmony with one another were all whole number fractions of the mass of the largest, or indeed of each other. Each was either half as heavy, two thirds as heavy, three quarters as heavy and so on. But the mass of the dissonant piece of metal could not be expressed as a proper fraction of the mass of the others.

This is probably not exactly what happened, but Pythagoras nonetheless did realise that there was a relationship between harmonious, or consonant, sounds and ratios of numbers. There was a mathematical beauty in musical harmony. This is sometime around 500BC and there is no earlier record of this kind of scientific study of harmony; previously musicians had simply tuned instruments by ear to produce pleasant harmonies.

Pythagoras demonstrated his discovery with taught strings of different lengths, using a moveable bridge to change the lengths of the strings. If one string is exactly half the length of another its pitch when plucked will be the same note exactly one octave higher. If you’re interested, this is how the fractions shake out in musical terms, the ratios being the relative lengths of the two strings:

·         Octave – 2:1

·         Fifth – 2:3

·         Fourth – 3:4

·         Major third – 4:5

·         Minor third – 5:6

·         Major sixth – 3:5

·         Minor sixth – 5:8

As you move away from these ratios, or fractions, dissonance occurs; as you move closer to them consonance increases.

After this it all starts getting a bit complicated – it turns out that it is the ‘beats’ created by different wavelengths of sound hitting your ears at slightly different times that creates the rough sound of dissonance.

But that’s enough for now. I still don’t have a clear idea of what my science and music stall will deliver, but it’s been interesting to think about why sound behaves in the way that it does, at least in terms of our perception of it. I shall keep working on the science stall plans, so watch this space for updates.

Glitch.

Hello World.

Dummm dumdumdum. G&D time!