update noindex behavior and add to relevant pages

We have two pages in robots.txt we don't want included in search results. Added the new noindex frontmatter value to those pages.

Also updated the noindex true value to return noindex, follow instead of noindex, nofollow.

cc @jgragnola @mnguyen4

Merge request reports

Loading