Controlling SEO Indexing on Companion Site with robots.txt File

Scott B.

·May 08, 2024 03:16 PM·

Is there a way to control what is indexed or not by SEO on the companion site? e.g. robots.txt file

👀2

19 comments

· Sorted by Oldest

Zach H.
·
·
We have those controls set at the Feed/Channel level where you can mark it as “Unlisted”. What level of control would you be interested in?
Scott B.
·
·
I was thinking more of an option that enables you to display the feed in the sidebar but exclude from SEO.
Zach H.
·
·
Good to note! Is there ever a case you’d want to hide a feed from the navbar? We might have been overzealous when we created the Unlisted option. My current thought:
Make Unlisted only relevant to SEO and not to the navbar
Scott B.
·
·
Not that I can think of. If I want it in the companion site it makes sense to display it Like your thinking
👍1
Scott B.
·
·
Or split into two options -- one for Nav bar and one for SEO
👍1
Zach H.
·
·
We might bring the option back in the future but only if a customer requests it. I VERY much don’t want to repeat our ways at Salesforce with overcomplicating controls
Scott B.
·
·
Understandable. Right now I'm more interested in managing the SEO side of things
Zach H.
·
·
Sounds good. Should be a quick and simple fix. ETA is 1-2 days
👍1
Stephen C.
·
·
Hey Scott B.! In the recent release we separated this into two Feed settings:
Unlisted from SEO
Show feed in sidebar menu
Loading attachments
Stephen C.
·
·
Unlisted feeds are disallowed in robots.txt and excluded from sitemaps
Scott B.
·
·
Cool on the unlisted, I've enabled. Navigation sidebar -- would rather display on the left, but hide from the right rather than removing all together.
Stephen C.
·
·
By the right, do you mean this part?
Loading attachments
Scott B.
·
·
Correct
Stephen C.
·
·
Would you prefer to hide that feed list altogether?
Scott B.
·
·
Yes, it's duplicative IMHO. The descriptions already show up on the feed pages and the navigation is already available at the left
👍1