The topics and activities for each week will be listed here.

<!-- -->

Start by watching the instructor video for this week. Do not forget to submit the rating for the peer feedback you received for Assignment 3 before the deadline.

Our focus for this last week is on finishing Assignment 4, so the following is just hints and tips for it.

First off, remember to export the game in its original state in its native format (Windows or Mac).

Next, you will need to remove existing audio from it. Most games will have a separate folder for Audio under Assets in the Project window. You can right-click on each AudioClip and select “Find References in Scene”. This will show you all GameObjects that are using this audio clip.

Finally, two useful links:

Unity User Manual

Unity C# Survival Guide

1. Complete the Reflect Phase of Assignment 3
2. Complete Assignment 4

Start by watching the instructor video for this week. Do not forget to submit the peer feedback for Assignment 3 before the deadline.

Our target this week is to learn about scripting with Unity. This will allow us to complete all requirements for A4. We'll also learn about reverb zones and ducking.

First, complete section 15. Introduction to Scripting of the Unity course. Then, read the Unity manual on scripting, in particular the first three sections: Setting Up Your Scripting Environment, Scripting concepts , and Important Classes.

Then, watch this video on how to export your game to the web. For A4, you should export your game for Windows or Mac instead. Export your game as downloaded now, and save it. When submitting A4, you will have to submit this .exe or .app file also to show that you have changed the audio in the game.

The game you are working with may already have a GameObject to manage all the audio (typically called AudioManager). You can reuse that if you want, but if you don't want to do that (or your game does not have any audio to begin with), I recommend creating your own AudioManager, following the example in this video (you can ignore the last part of this video that deals with multiple scenes unless you have lots of time on your hands).

To add appropriate reverb to your sounds, you can add reverb to the appropriate Audio Group in the Audio Mixer, or use reverb zones. Start by watching tis video on reverb zones. If you want to trigger reverb (or any SFX) using a collider, see this video. Finally, you can check out the Unity manual for Reverb Zones and Colliders.

To achieve ducking, e.g. automatically lowering music when narration is happening, see this video.

Implementing a fade in/out is a bit harder than you might think because these gradual changes in volume have to happen across multiple frames. Thankfully, C# has a feature that is really well suited for this, coroutines. Read the Unity Manual on coroutines that contains a visual fade in/out example that you can adjust for audio.

Finally, you can use any plugins you develop with JUCE in Unity! This is not a requirement for A4, but if you'd like to do that, follow these instructions.

1. Submit detailed feedback on the A3 peer submissions you received
2. Export the initial version of your game to the web, and save the link
3. Study the material on scripting with Unity
4. Continue working on Assignment 4. After studying the material above, you have all the information you need to complete it

Start by watching the instructor video for this week. Do not forget to submit Assignment 3 before the deadline.

Our next target is to learn about audio in video games.

Start by studying the slides on Game Audio. They describe the process for audio in large video games, so they won't necessarily apply to Assignment 4.

Continue with our Weekly Unity Background: Complete Section 9. Adding Audio.

Finally, study Assignment 4 (click on the Sidebar to find it) and choose a game to work with. Look for sound files that you will use for A4 online. Places to look into:

• freesound.org Creative Commons Licensed sounds
• Sound effects Creative Commons Licensed sounds
• Production Crate (paid but has free trial)
• Epidemic Sound (paid but has free trial)
• bensound.com Royalty-free music

1. Complete and submit Assignment 3
2. Study the A3 peer submissions you will receive and provide detailed feedback
3. Study the Game Audio slides
4. Learn about audio in Unity
5. Read and understand Assignment 4
6. Choose an existing Unity game that you will work with for Assignment 4 and find sounds for it

Start by watching the instructor video for this week. Do not forget to submit the rating for the peer feedback you received for Assignment 2 before the deadline.

Our focus this week is on finishing Assignment 3, as well as learning about audio file formats.

Start by watching this video on the most common types of audio formats.

Next, study the slides on audio file formats, and complete the eClass quiz on it.

Finish with this video on what is lost when compressing audio. Video has several loud parts, so watch at low volume to begin with.

Finally, continue with our Weekly Unity Background: Complete Section 8. Collisions.

1. Complete the Reflect Phase of Assignment 2
2. Complete Assignment 3
3. Understand audio file formats and complete the eClass quiz on it
4. Continue with Unity

Start by watching the instructor video for this week. Do not forget to submit the peer feedback for Assignment 2 before the deadline.

Our next target is to learn about impulse responses and convolution, concepts that will be needed for the second and third reverb in Assignment 3.

Start by watching a video on what reverb is, and a video on how to create reverb with delays and convolution. These are both from LinkedIn Learning, so you'll need to login with Passport York.

Continue by watching this video on the theory behind impulse responses and convolution. The input function in our case is the incoming audio signal, and the linear system is the plugin you are developing. The video describes impulse responses in a continuous fashion, but if you imagine each input pulse as a sample everything else still works.

Next, study the slides on convolution and impulse responses. They contain useful hints with regard to implementing Assignment 3.

Finally, continue with our Weekly Unity Background: Complete Section 7. Creating and Implementing Animation.

1. Submit detailed feedback on the A2 peer submissions you received
2. Study the material on impulse responses and convolution
3. Continue working on Assignment 3. After studying the material above, you have all the information you need to complete it.
4. Continue with Unity

Start by watching the instructor video for this week. Do not forget to submit Assignment 2 before the deadline.

Our next target is to learn how to use the digital signal processing (DSP) module in JUCE to build plugins that implement and combine various audio effects.

Start by studying the slides on Audio Effects. There is an eClass quiz related to these slides.

For a different look at these effects (and more) check out this playlist (ignore the first video on Console Signal Flow). This video on compression is also worth checking out. If you have not heard a wahwah effect, check this out.

Before we look at the starter code for Assignment 3, take a look at this video on including a plugin to play an audio file in the Audio Plugin Host. You can find the code on github.

Next, it's time to look at the starter code. There's 3 videos on it:

1. A demo of the plugin functionality
2. A description of the new way to handle parameters
3. A description of the processing part

Finally, continue with our Weekly Unity Background: Complete Section 6. Level Building.

1. Complete and submit Assignment 2
2. Study the A2 peer submissions you will receive and provide detailed feedback
3. Study audio effects and complete the eClass quiz on it
4. Read and understand Assignment 3
5. Compile and understand the starter code for Assignment 3
6. Continue with Unity

Start by watching the instructor video for this week. Do not forget to submit the rating for the peer feedback you received for Assignment 1 before the deadline.

Our focus this week is on finishing Assignment 2, as well as learning about the human sound perception.

Start by watching this video on the Human Sound Perception System.

Next, study the slides on Sound Perception, finishing with a fun video on Auditory Illusions.

Finally, continue with our Weekly Unity Background: Complete Section 5. Prefabs.

1. Complete the Reflect Phase of Assignment 1
2. Complete Assignment 2
3. Understand human sound perception and complete the eClass quiz on it
4. Continue with Unity

Next week is Reading Week, so there is no new material to study, just an instructor video. Do not forget to submit the peer feedback for Assignment 1 before the deadline.

If you are catching up on Unity during Reading Week, you can download the Measured Materials library mentioned in the course here. Note that this is a large file (approx. 1.5GB).

Start by watching the instructor video for this week. Do not forget to submit Assignment 1 before the deadline.

Our next target is to develop plugins that receive audio as input, and produce modified audio as output.

Start by studying the slides on Digitizing Sound.

Next, watch this video on Digital Audio. The second part of this video is on Digital Video, so it is not relevant to our course, so watch that part only for your own interest.

Follow up with another video on digital reconstruction. The section on dithering can be skipped if you are pressed for time.

Now you are ready to look at some code. Study the starter code for Assignment 2 and make sure you understand it. To help you out, there is also:

1. A set of slides

1. An instructor video on it

Finally, continue with our Weekly Unity Background: Complete Section 4. Applying materials. This section is all about changing the look of different materials in your scenes, so it does not apply to our course directly. As a result, this week's Unity section is mostly for your own interest.

1. Submit Assignment 1 before the deadline
2. Study the A1 peer submissions you will receive and provide detailed feedback
3. Understand how digital audio conversion works
4. Read and understand Assignment 2
5. Compile and understand the starter code for Assignment 2
6. Continue with Unity

Start by watching the instructor video for this week.

Continue with a video on debugging.

This week we will focus on making the GUI of our plugin look nice. Study the following JUCE tutorials (no need to open them as separate projects, just cut and paste from the tutorial to your code as necessary):

The Slider class: This tutorial will show you how to customize a Slider. Notice the section titled “Responding to slider changes” for an example of how to tell which slider has been changed.

Depending on the design of your plugin, you will need some other types of GUI components. See the tutorials for labels, combo boxes, and radio buttons and checkboxes.

To improve the look of your plugin even further, you can look into the following tutorials as well:

• The Graphics class: To draw simple lines and shaped on your GUI.

• Customize the look and feel: To change the looks of default components.

Weekly Unity Background: Complete Section 3. Working with Assets.

1. This week's pod meetings are only a day or two away from the A1 deadline, so you should have completed the functionality part of the assignment by then, while the look and feel of your GUI should be getting there.
2. Continue with Unity

Start by watching the instructor video for this week.

Next, a video tutorial on processBlock.

The Arpeggiator Plugin: This tutorial explains the code of a simple Arpeggiator plugin. You will make a more elaborate one for Assignment 1. I have modified the code a bit and posted it as Starter Code in the Assignment 1 page. Focus on the explanation for prepareToPlay and processBlock in the tutorial. Do NOT enable the “MIDI Effect Plugin” option in the “Plugin Characteristics” field of the project settings in the Projucer, only the “Plugin MIDI Input” and “Plugin MIDI Output” ones.

Slides on coding with JUCE. Includes information on C++ concepts you should know to understand the code.

Weekly Unity Background: Complete Section 2. Understanding the Unity interface

1. Compile and test the JUCE Arpeggiator plugin
2. Understand the code for the JUCE Arpeggiator plugin
3. Start on coding Assignment 1. You now know everything you need to add all the functionality required by the assignment. We'll make the GUI better next week.
4. Continue with Unity

Start by watching the instructor video for this week.

Next, a video tutorial on using the tools for the course. Click on the OS you are using: Windows or MacOS.

Next, go through the following tutorials for JUCE:

Getting started with the Projucer: This tutorial will help you install JUCE if you haven't already, and will guide through creating a JUCE project and bringing it up in Visual Studio.

Create a basic plugin, Part 1: This tutorial will help you set up an empty MIDI plugin, and create the Audio Plugin Host. The tutorial says that this step is optional, but you should definitely do it, otherwise you will not be able to test your plugin.

Coding your plugin: This tutorial will help you create a MIDI plugin that affects the volume of incoming MIDI events. If you get an error because uint8 is an unrecognized type, change it to juce::uint8. See an eClass announcement for more details.

The Physics of Sound

Slides

Weekly Unity Background: Complete the Introduction and Section 1. Setting Up the Unity Project. Login with your Passport York account (the email should be ppy@yorku.ca, not ppy@my.yorku.ca). The Measured Materials package mentioned is no longer in the Asset Store, so you can ignore that part for now. We will import such materials when needed later.

1. Compile and test the volume MIDI plugin
2. Understand the code for the volume MIDI plugin
3. Read and understand Assignment 1 (repeated goal from last week)
4. Understand the physics of sound and complete the eClass quiz on it
5. Get started with Unity

Start by watching the instructor video for this week.

If you are using your own computer for the programming assignments, install JUCE, Visual Studio (Community), and Unity Hub.

If you will be using the EECS Virtual Lab, become familiar with it here. For EECS 4462, use any of the GSP hosts. Make sure to locate the Projucer app (click on Shortcuts), the Visual Studio app, and the Unity app (use the Search function).

What is MIDI?

Slides (for reference only)

Wikipedia page on MIDI (for reference only)

1. Install all necessary software
2. Understand what MIDI is at a high level
3. Read and understand Assignment 1

<!--   ===== Module 1 =====   Topic: The Physics of Sound   Slides: {{:module01-physicsofsound.pdf|PDF}}   ===== Module 2 =====   Topic: Sound Perception   Slides: {{:module02-soundperception.pdf|PDF}}   ===== Module 3 =====   Topic: MIDI   Slides: {{:module03-midi.pdf|PDF}}   ===== Module 4 =====   Topic: MIDI plugins in JUCE   Slides: {{:module04-juce.pdf|PDF}}   ===== Module 5 =====   Topic: GUIs with JUCE   Slides: {{:module05-juceguis.pdf|PDF}}   ===== Module 6 =====   Topic: Digitizing Sound   Slides: {{:module06-digitizingaudio.pdf|PDF}}   ===== Module 7 =====   Topic: Audio Plugins with JUCE   Slides: {{:module07-audiopluginsjuce.pdf|PDF}}   ===== Module 8 =====   Topic: Generating sound   Slides: {{:module08-generatingsound.pdf|PDF}}   ===== Module 9 =====   Topic: Audio formats   Slides: {{:module09-audioformats.pdf|PDF}}   ===== Module 10 =====   Topic: OpenAL   Slides: {{:module10-openal.pdf|PDF}}   Code: {{:classcode.zip|ZIP}}   Sounds: {{:sounds.zip|ZIP}}   ===== Module 11 =====   Topic: Game Audio Programming   Slides: {{:module11-gameaudio.pdf|PDF}}   ===== Module 6.5 =====   Topic: Measuring Loudness   Slides: {{:module6.5-measuringloudness.pdf|PDF}}   ===== Module 12 =====   Topic: Audio effects   Slides: {{:module12-processing.pdf|PDF}}     ===== Week 2 =====   ===== Midterm =====   ===== Drop Deadline =====   ===== Week 13 =====   ===== Final Exam =====   -->