Ask HN: How do you test CMS-based websites?

Running a large complex content website with frequent code deployments and content updates. We do have manual testing in place, but I would like to add some automated testing.

Things I'll want to test:

* pages loading properly without errors * module-based content shows (as in excerpt of latest blog posts show on the home page etc.) * page modules like accordions and carousels function properly * navigation functions properly * forms submit (might have to forego this one as most forms depend on recaptcha submission)

What I have looked at:

Selenium -- the firefox ide seems a bit buggy

Katalon studio -- the files it produces are not fully compatible with Selenium (last time I checked).

We do have Ruby experience so also considering watir although not much experience with it. IDE-based test creation would be much faster though.

What do you use for website testing? I am interested not only in tooling , but also process: how do you create the tests, what do you test, how often, how do you audit the results?

How do you maintain the tests (content changes frequently).

Thank you.