Week 4Algorithmic composition sonificationAlgorithms are formulas or rules describing the behaviour of the computer. Began with the abacus of ancient times.

Music for Visual MediaThere are four types of sounds in a visual media production: Dialogue Effects Ambiance (atmosphere) Music (film score) Sound EditingThe essential piece of equipment used in modern day sound editing is known as the mulit-track digital audio workstation, or DAW. The standard DAW system in use by the American film industry, as of 2012, in Avids pro-tools, with the majority running on Mac.Sound effects and sample library Sound effect editors typically use an organized catalogue of sound recordings, from which sound effects can be easily accessed and used in film soundtracks.Sound in FilmsThe aural properties of sound timber, volume, reverb etc., have a major effect on the films aesthetic.Sound, contrary to sight, presupposes movement. Sound in its nature implies a displacement. Sound can suggest stasis, but only in limited cases. Most films tell a story.Each film creates its own filmic world, called diegesis. Everything that happens in this world is called diegetic, and everything that happens outside of it is called non-diegetic. Diegetic SoundSound whose source is viable on the screen or whose source is implied to be present by the action of the film: Voices of characters Sounds made by objects in the story Source music, represented as coming from instruments in the story space Basic sound effects e.g. dogs barking, cars passing Music coming from reproduction devices such as radios etc.Diegetic sound can be either on screen or off screen depending on whether its source is in the frame or out if the frame.Any voice, musical passage or sound effect presented as originating from a source within the film is diegetic.Non-diegetic soundNon-diegetic sound is represented as coming from a source outside of the story. Sound whose source is neither visible on screen nor has been implied to be present in the action: Narrators commentary Sound effects which is added for dramatic effect Mood music Film scoreNon-diegetic sound plays a significant role in creating the atmosphere and mood within a film. Audio-visual relationshipHarmony or counterpoint? Audio-visual dissonanceThe most common function of film sound consists of unifying or binding the flow of images. First, it unifies by bridging the visual breaks by sound overlaps. Second, it brings unity by establishing atmosphere. Third, sound can provide unity through non-diegetic sound. (Part 2)Film MusicFilm musics primary function is to serve the narrative and is almost invariably designed to accompany what is on screen. It is not usually intended to be listened to on in its own right. Usual functions of film music: Emotional signifier sense the invisible Continuality music smooths discontinuous visual scenes Narrative cueing provides advanced knowledge of the narrative Narrative unity musical forms support the narrative

Sound effects (FX)Sound effects are artificially created sounds, or sound processes used to emphasise artistic or other components of films.In motion picture and television, a sound effect is a sound recorded and presented to make a specific storytelling or creative point without the use of dialogue or music. Dialogue, music and sound effects are treated as separate components. Dialogue and music recordings are never referred to as sound effects, even though the processes applied to them, such as reverberation or flanging effects, are often called sound effects. Foley is the reproduction of everyday sound effects which are added in post-production to enhance the quality of audio for films. Foley is more of a technique for creating sound effects, than a type of sound effect. Types of Sound Effects: Hard sound effects common sounds that appear on screen, such as a door slamming, weapons firing or cars driving past. Background (BG) sound that do not explicitly synchronize with the picture, but indicate setting to the audience, such as forest sounds, the buzzing of fluorescent lights or car interiors. The sound of people talking in the background is also considered BG, but only if the speaker is unintelligible and the language is unrecognisable. These background sounds are also called ambiance or atmos. Foley sound effects sounds that synchronize on screen and require the expertise of a Foley artist to record properly. Footsteps, the movement of hand props and the rustling of cloth are common Foley units. Design sound effects sounds that do not normally occur in nature, or are impossible to record in nature. The sounds are used to suggest futuristic technology in a science fiction film for example. Applying sound to film Voice OverWhen the voice of a character in the film is heard, while we see an image of a space and time in which that character is not actually speaking. (Diegetic) The voice over is often used to give a sense of the characters subjectivity or to narrate an event told in a flashback. It is often associated with genres such as Film Noir, and its characters with a dark past.It also features predominantly in most films dealing with autobiography, nostalgia and literally adaptation. Synchronous soundSound that is matched temporarily with movements occurring in the images, as when dialogue corresponds to lip movements.The norm in Hollywood film is to synchronize sound and image at the moment of shooting; other national cinemas do it later. Direct soundWhen using direct sound, the music, noise and speech of the event at the moment of filming is recorded in the film. This is the opposite if post-synchronisation, in which the sound is dubbed on top of an existing, silent image.Studio systems often use multiple microphones to record directly. Some national films, notably Italy, India and Japan, have avoided direct sound at some stage in their past and dubbed the dialogues to the film after shooting. Post-synchronisationThe process of adding sound to images, after they have been shot and assembled. This can include the dubbing of voices, as well as inserting diegetic music or sound effects.It is the opposite of direct sound. Process of creating the sound designWhile reading the script identify the following: Objects Actions Environment Emotions TransitionsTo define the emotions, read the cues for adjectives and adverbs.Identify and define the transitions as dramatic or subtle, physical or emotional.Draw visual maps visualising patterns of opposition in the narrative (life and death, power and weakness, harmony and dissonance, friendly and menacing) Construct a cue-sheet a spread sheet time code of all sounds (dialogue, effects, ambience, and music)

Mobile Orchestras