Hey Beth S., what are you planning to do with the corresponding channel within Slack?
If it will remain an open/active channel, then all you have to do is change the Feed settings to not be in the Navigation Sidebar, which we support today (docs)!
If you plan to archive the slack channel, then the feed will also be auto archived. We would need to do some work to allow archived feeds to appear on the site.