mlp: store the channel layout for each substream.