Skip to content

Verified mel spectrograms in winml sample against pytorch #400

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
janezdu wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Verified mel spectrograms in winml sample against pytorch #400

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
805e3db
New HSV colouring, implemented in cs
janezdu Jul 6, 2021
77085b5
Compare hsv to rgb
janezdu Jul 6, 2021
c45f2d6
Refactor colorizing code
janezdu Jul 6, 2021
2b89b27
Add toggles to UI
janezdu Jul 6, 2021
b9dec10
Hook up UI controls to melspectrogram settings
janezdu Jul 6, 2021
7656bb8
Merge branch 'master' of https://github.com/microsoft/Windows-Machine…
janezdu Jul 6, 2021
c2d7c3e
code + ui cleanup
janezdu Jul 6, 2021
8c55c97
Refactor and resampling via convolution
janezdu Jul 8, 2021
14ec744
Remove transpose and flip for verification with pytorch
janezdu Jul 22, 2021
b87c90b
Code cleanup and updated preprocessing .onnx models
janezdu Jul 23, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Compare hsv to rgb
  • Loading branch information
@janezdu
janezdu committed Jul 6, 2021
commit 77085b5d322effbcc0239a0f3483d2600cff83f9
3 changes: 2 additions & 1 deletion Samples/AudioPreprocessing/WinUI/AudioPreprocessing/AudioPreprocessing/MainWindow.xaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,8 @@
HorizontalAlignment="Center" VerticalAlignment="Center" />

<StackPanel HorizontalAlignment="Center" Background="White" Orientation="Horizontal">
<Image Name="spectrogram" Stretch="Fill" Height="500" Width="500" />
<Image Name="spectrogramComputational" Stretch="Fill" Height="500" Width="300" />
<Image Name="spectrogramBitmapEdited" Stretch="Fill" Height="500" Width="300" />
</StackPanel>
</StackPanel>
</Window>
22 changes: 17 additions & 5 deletions Samples/AudioPreprocessing/WinUI/AudioPreprocessing/AudioPreprocessing/MainWindow.xaml.cs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,17 +32,28 @@ public MainWindow()
{
InitializeComponent();
ViewModel = new PreprocessViewModel();
spectrogram.Source = new SoftwareBitmapSource();
spectrogramComputational.Source = new SoftwareBitmapSource();
spectrogramBitmapEdited.Source = new SoftwareBitmapSource();
}

public PreprocessViewModel ViewModel { get; set; }
private async void OnOpenClick(object sender, RoutedEventArgs e)
{
string wavPath = await GetFilePath();
PreprocessModel melSpectrogram = new PreprocessModel();
var softwareBitmap = melSpectrogram.GenerateMelSpectrogram(wavPath, ColorMelSpectrogramCheckBox.IsChecked ?? false);
//PreprocessModel.Colorize(VideoFrame.CreateWithSoftwareBitmap(softwareBitmap), 0.5f, 0.3f);

bool colorize = ColorMelSpectrogramCheckBox.IsChecked ?? false;
// Use bitmap editing, pixel by pixel, to colorize image, if box is checked
SoftwareBitmap softwareBitmap = melSpectrogram.GenerateMelSpectrogram(wavPath, colorize);
// Use computational graph to colorize image, if box is checked
SoftwareBitmap computationalSoftwareBitmap;
if (colorize)
{
computationalSoftwareBitmap = PreprocessModel.ColorizeWithComputationalGraph(VideoFrame.CreateWithSoftwareBitmap(softwareBitmap), 0.7f, 0.5f);
}
else
{
computationalSoftwareBitmap = softwareBitmap;
}
ViewModel.AudioPath = wavPath;
ViewModel.MelSpectrogramImage = softwareBitmap;

Expand All @@ -56,7 +67,8 @@ private async void OnOpenClick(object sender, RoutedEventArgs e)

WavFilePath.Text = ViewModel.AudioPath;

await ((SoftwareBitmapSource)spectrogram.Source).SetBitmapAsync(softwareBitmap);
await ((SoftwareBitmapSource)spectrogramComputational.Source).SetBitmapAsync(softwareBitmap);
await ((SoftwareBitmapSource)spectrogramBitmapEdited.Source).SetBitmapAsync(computationalSoftwareBitmap);
}

private async Task<string> GetFilePath()
Expand Down
Loading