Hardest part is that there is no "user" that would be clicking the button so we technically will break anything you have working inside of Slack workflows.
Realistically we would need to build our own API webhook for this so that you could control this separately.
Jacob G. would you be able to share a screenshot of what this message looks like in Slack?
Stephen C. I wonder if we have a little "warning" if a workflow is attached that "Workflows only work in Slack" and then when a user clicks it, it pops up a modal with the Slack permalink.