author: Juma Shafara date: "2024-08-12" title: Multiple Channel Convolutional Network keywords: [Training Two Parameter, Mini-Batch Gradient Decent, Training Two Parameter Mini-Batch Gradient Decent] description: In this lab, you will learn two important components in building a convolutional neural network.

Objective for this Notebook

1. Learn on Multiple Input and Multiple Output Channels.

Table of Contents

In this lab, you will study convolution and review how the different operations change the relationship between input and output.

Import the following libraries:

Multiple Output Channels

In Pytroch, you can create a Conv2d object with multiple outputs. For each channel, a kernel is created, and each kernel performs a convolution independently. As a result, the number of outputs is equal to the number of channels. This is demonstrated in the following figure. The number 9 is convolved with three kernels: each of a different color. There are three different activation maps represented by the different colors.

Symbolically, this can be represented as follows:

Create a Conv2d with three channels:

Pytorch randomly assigns values to each kernel. However, use kernels that have been developed to detect edges:

Each kernel has its own bias, so set them all to zero:

Print out each kernel:

Create an input image to represent the input X:

Plot it as an image:

Perform convolution using each channel:

The result is a 1x3x3x3 tensor. This represents one sample with three channels, and each channel contains a 3x3 image. The same rules that govern the shape of each image were discussed in the last section.

Print out each channel as a tensor or an image:

Different kernels can be used to detect various features in an image. You can see that the first channel fluctuates, and the second two channels produce a constant value. The following figure summarizes the process:

If you use a different image, the result will be different:

In this case, the second channel fluctuates, and the first and the third channels produce a constant value.

The following figure summarizes the process:

Multiple Input Channels

For two inputs, you can create two kernels. Each kernel performs a convolution on its associated input channel. The resulting output is added together as shown:

Create an input with two channels:

Plot out each image:

Create a Conv2d object with two inputs:

Assign kernel values to make the math a little easier:

Perform the convolution:

The following images summarize the process. The object performs Convolution.

Then, it adds the result:

Multiple Input and Multiple Output Channels

When using multiple inputs and outputs, a kernel is created for each input, and the process is repeated for each output. The process is summarized in the following image.

There are two input channels and 3 output channels. For each channel, the input in red and purple is convolved with an individual kernel that is colored differently. As a result, there are three outputs.

Create an example with two inputs and three outputs and assign the kernel values to make the math a little easier:

For each output, there is a bias, so set them all to zero:

Create a two-channel image and plot the results:

Perform the convolution:

The output of the first channel is given by:

The output of the second channel is given by:

The output of the third channel is given by:

Practice Questions

Use the following two convolution objects to produce the same result as two input channel convolution on imageA and imageB as shown in the following image:

Double-click here for the solution.

What's on your mind? Put it in the comments!