Unfortunately, vscode modals are difficult to control. You can't trigger vscode modals to close after a timeout or close after a change.

I'm considering the idea of a modal in the sidebar with a fixed position over. It could be in the top center or bottom center. @argemiront Thoughts?