Sensor Technology

Sensor Technology Materials List

Resources

Performance/demonstration programme

Performance/demonstration programme
tba, Hel 040
Please read the detailed submission notes
SIDs	Name	email	Time
SID	Name	email	Time

Tutorial Groups

N.B. You are all invited to attend tutorial slots, but if you do so you must have prepared something for us to look at. If you feel that you do not need to attend that is fine, but please let me know in order to release the time for those who feel that they need it... Please come a little early if possible and be prepared to wait a little if necessary. N.B., these slots have not yet been arranged into groups involving cognate projects, so there may be changes.
1200-1225 SID NAME INITIAL

Summary

Sensor Technology Materials List

Concentrating on aspects of technology that enable live performance and audio manipulation, this module is designed to provide the knowledge and opportunity for students to create their own performances and sonic installations. Students will be expected to actively pursue their own opportunities for performance/exhibition. Module materials will be based around the type of electronic components used for a variety of methods of controlling hardware and software: sensors (for example, those used in game controllers); and, chips and boards for the creation, manipulation and storage of sound. Of equal importance will be the implementation of the crucial and complex links between technology, performers, electronic sound and the audience. Students will gain experience through a series of tasks and projects culminating in a final performance or exhibition. Students will submit their collected exercises in a portfolio, accompanied by audio-visual documentation as necessary and a brief critical evaluation, which should reference the current literature on sensor technology. This critical evaluation should place the student's work in the context of current trends in sensor technology as well as providing a basis for the student's own criteria and judgement. A materials charge may apply for this module.

Content

Investigate the effect of the user interface (software and hardware, including acoustic instruments) on musical performance.
Review, test and use a variety of hardware/software resources.
Design, implement and perform using custom hardware and software.

Outcomes

1. Analyse particular technical requirements (for instance, choose a particular sensor or configuration of sensors to achieve a musical goal); design and implement solutions for those requirements;
2. Transform abstract data and concepts towards a given purpose and design novel solutions Ð for instance capturing the data in particular movements and translating this into musical gestures;
3. Be confident and flexible in identifying and defining complex problems and the application of appropriate knowledge, tools/methods to their solution;
4. Operate in complex and unpredictable contexts, such as a musical performance, requiring selection and application from a wide range of innovative or standard techniques.

Reading and Listening

Banzi, M., (2009), Getting Started with Arduino, North Sebastopol, California: O'Reilly Media Inc.
Bishop, C. (2005) Installation Art, London: Tate Publishing
Broadhurst, S. and J. Machon (2006). Performance and technology : practices of virtual embodiment and interactivity. Basingstoke, Palgrave Macmillan.
Broadhurst, S. (2007). Digital practices : aesthetic and neuroesthetic approaches to performance and technology. Basingstoke, Palgrave Macmillan.
Dale D., ed. (2005-present) Make volumes 10-present: Technology on your time, North Sebastopol, California: O'Reilly Media Inc.
Emmerson, S. (2000) Music, Electronic Media and Culture, Kent : Ashgate
Igoe, T., (2007), Making Things Talk, North Sebastopol, California: O'Reilly Media Inc.
Miranda, E. R. (2006) New digital musical instruments: control and interaction beyond the keyboard, Middleton: A-R Editions
O'Sullivan, D. & T. Igoe, eds. (2004) Physical Computing: Sensing and Controlling the Physical World with Computers, London: Premier Press
Rosenthal, M. (2003) Understanding Installation Art, London: Prestel

Worth a look:

Cook, Perry R, 1999, Music, cognition, and computerized sound: an introduction to psychoacoustics, (Cambridge, Mass.: MIT Press)
Eduardo Miranda, 2001, Composing Music with Computers
Curtis Roads, 1996, Computer Music Tutorial, Part 5

Looking and listening:

Zimoun

Resources You Will Need

Task, Project Summary and Assessment Summary

The Logbook

All work on tasks and presentations as well as documentation of your projects should be collected together into a Logbook. You can optionally include a physical copy of the logbook, but an electronic verision must be submitted.

The logbook is worth 40% of your total mark.

The logbook should include:

A week by week log of your work and activities. It is recommended that you maintain your logbook each week.
photographs and videos of each task, including screenshots of any code that you have used
a written description of aims, int entions and outcomes
a critical evaluation of compositions and patches. You should reference other examples and practitioners in the field to contextualise your work in the light of others' work.
You may use up to 500 words (~250 words tasks, ~250 words critical reflection).

The logbook can be compiled using any word processing software, but can only be submitted as a pdf document. Refer to submitted movies from within the logbook, and include the movies separately in the submission. Images can, of course, be included in the logbook.

There is an absolute limit of 700MB data per submission. Submissions which include more than this amount of data will lost 5% of marks per 50MB exceeded. So, a 750MB submission would lose 5%, an 850MB submission 15%;
Please ensure that any videos you include are compressed (e.g. mp4), rather than dv. We are not interested in super-high-quality video for assessment purposes.
All documentation must be submitted in electronic versions.
A recorded version of your composition/performance;
Guidelines on how to use the item (these should be checked with a colleague to ensure that they are properly usable). Please include photographs/videos of the item in operation, including any software or firmware developed.
For information about the presentation, please see below or this document.

All assignments should be submitted to the i-centre by 2pm on Monday 19th December 2016
You need to submit at least the tasks with specified percentages (e.g. tasks 4, 6, 10 and the individual project), plus one of the other tasks - you choose.
All material should be submitted in the form of a logbook (see above).

	Task	Set	Value (%)
1	revision: "Hello world!"	w1i	0%
2	revision: Vibrating a piezo	w1i	0%
3	revision: Connecting the Arduino, MaxMSP and SuperCollider	w1i	0%
4	Auduino	w2i	assessable/recommended (10%)
5	Servos	w3i	assessable/recommended (10%)
6	Ping - Joining Code	w4i	assessable/recommended (10%)
7	Investigating sensors - Make your own sensor - Make your own arduino	w6i	assessable (10%)
8	Triggering and modulating events	w5i	assessable (10%)
9	Advanced sensors	w7i	assessable (10%)
10	Presentations	w8i	assessable/recommended (10%)
11	Audio Shield	w9i	assessable/recommended (10%)
12	Multiplexing	w9i	assessable (10%)
Final (Individual) Project	Final Assignment - Choose some aspect covered during the course to concentrate on and complete a creative project for performance towards the end of the course. The assessable (10%) weighting for the Individual Project includes the following potential deductions: 10% for non-performance without good reason; 10% for non-submission of a recording of you performing live; Failure to submit either of the above will result in failure of the module. In addition, your documentation will include a potential 10% deduction if it is unsatisfactorily presented.	w8i	compulsory (60%)
All assignments should be submitted to the i-centre by 2pm on Monday 19th December 2016

Assessment Criteria

Your work will be marked according to the criteria set out in the document Artefact Creation (document available via University Login only).

tasks

Detailed Outline

Week

Focus

Project/Task

- Assessments
- Introduction to Sensor Technology

Different Boards
Arduino - http://www.arduino.cc/
Wiring - http://www.wiring.org.co/
USB Create - http://www.create.ucsb.edu/~dano/CUI/
Gainer - http://gainer.cc/

Sensor Technology Materials List

If you haven't taken Circuit Bending 
(formerly Performance Technology)
You might want to go through a few things...
- Getting Started
- The Seven Basic Rules of Hacking
- How to Solder

- List of sensors (Wikipedia)

Reading
 Read the M.Banzi 'Arduino Getting Started', it will help you to understand the
- basics of the Arduino hardware and software
- basics of electricity (definitely worth reading from p.25)
- Box of Broadcasts

Some revision from circuit bending
- Ghazala, Reed, (2005) 
Circuit-bending: build your own alien instruments, 
Indianapoli: Wiley Publishing) 
- Chapters 1 and 2

- Collins, Nicolas, (2006) 
Handmade electronic music: the art of hardware hacking 
New York: Routledge 
- Chapters 1 and 2

Focus
- Basic Electricity
- Make: Electronics

- Interactive Science Simulations
- Circuit Construction Lab
- Other resources: Fritzing, Macspice, Yenka

- Breadboarding:
-- Intro on Sparkfun
-- Tom Igoe Tutorial/Site
-- Intro to Breadboarding [1MB pdf]
-- Intro to Breadboarding [505 KB pdf]
-- Intro to the Arduino [254KB pdf]

- Using a Piezo disc to make sounds
- Give the sounds a duration
- Generate and Modulate Pulses
- Notes Over the Serial Port with Duration Controlled by a Potentiometer
- Use the Arduino Board with Max (preview)

notes

Task 1
 - "Hello world!"
task 1 due: Monday 19th December 2016
task 1 weighting: 0%

Task 2
 - Vibrating a piezo
task 2 due: Monday 19th December 2016
task 2 weighting: 0%

Task 3
 - Connecting the Arduino, MaxMSP and SuperCollider
task 3 due: Monday 19th December 2016
task 3 weighting: 0%

task summary |  VLE

Sensor walk: walk around your neighborhood, or a different one. 
Take a count of every interaction with a sensor you see. 
These might include:
- Pushbuttons on an ATM
- motion sensors on doors, taps, etc.
- Floor mats
- Cameras
Take pictures or video as appropriate, of the most interesting ones.

Prepare to take us through what you think is happening during next week's class.

- Auduino
- Arduino Audio 1
- You might also want to look at the Daisybell project.
- Audio on the Arduino pages
- Audio on the Arduino page 1

notes

Task 4
 - Auduino
task 4 due: Monday 19th December 2016
task 4 weighting: assessable/recommended (10%)

task summary |  VLE

tasks

Focus
- Group Design Project
- Connecting Arduino to Breadboard
- Ladyada Arduino Tutorials

- Arduinos, Motors and Servos
Make video connecting Arduino to a servo
- Using triggers in MaxMSP and SuperCollider


notes

Task 5
 - Servos
task 5 due: Monday 19th December 2016
task 5 weighting: assessable/recommended (10%)

Task 6
 - Ping - Joining Code
task 6 due: Monday 19th December 2016
task 6 weighting: assessable/recommended (10%)

task summary |  VLE

- Using triggers in MaxMSP and SuperCollider
- Presentation Chooser if necessary v001
- Presentations for week 7

notes

Task 7
 - Investigating sensors - Make your own sensor - Make your own arduino
task 7 due: Monday 19th December 2016
task 7 weighting: assessable (10%)

task summary | VLE | VLE

- Investigating sensors
- Make your own sensor
- Make your own arduino

Task 8
 - Triggering and modulating events
task 8 due: Monday 19th December 2016
task 8 weighting: assessable (10%)

task summary |  VLE

tasks

Advanced sensors: Kinect, Leap Motion, etc.

notes

Task 9
 - Advanced sensors
task 9 due: Monday 19th December 2016
task 9 weighting: assessable (10%)

task summary |  VLE

Presentations

notes

Task 10
 - Presentations
task 10 due: Monday 19th December 2016
task 10 weighting: assessable/recommended (10%)

task summary |  VLE

- Multiplexing (optional)
- Tutorials and Individual Project Discussions

notes

Task 11
 - Audio Shield
task 11 due: Monday 19th December 2016
task 11 weighting: assessable/recommended (10%)

task summary |  VLE

- Wireless
- Tutorials and Individual Project Discussions

Other information:
- Connecting to Processing

notes

Task 12
 - Multiplexing
task 12 due: Monday 19th December 2016
task 12 weighting: assessable (10%)

task summary |  VLE

- Tutorials and Individual Project Discussions

No task

task summary |  VLE

- Tutorials and Individual Project Discussions

- Performances

tasks