StackStorm: Event-driven automation

https://github.com/StackStorm/st2

by gjvc • 4 years ago

104 33 4 years ago

github.com

throwawaaarrgh• 4 years ago

I love the design, but it just seems mostly abandoned. Maybe it needs better marketing?

tempest_• 4 years ago

In what sense?

The repo linked here appears to have contributions merged in that last month and it has a bunch of active pull requests.

eugenc4• 4 years ago

One of the maintainers during EU late night here.

* The release management team is preparing the v3.8.0 release right now, - coming out soon next week.

* There are 15 Maintainers (https://github.com/StackStorm/st2/blob/master/OWNERS.md) in the Technical Steering Committee (TSC), a very diverse group, but I'd say only 1/3 or half are really active.

* There are monthly TSC meetings and we invite curious to join us: https://github.com/StackStorm/community/issues/33 (next meeting is on 6th Dec).

* Past Meetings: https://github.com/StackStorm/community/issues?q=is%3Aissue+...

* The project is under the neutral Linux Foundation umbrella with no single commercial owner, so probably why less marketing. We have blog/twitter/linkedin with the mostly engineering updates for engineers.

But I agree with the sentiment overall, - the development velocity could be higher and we definitely welcome new contributors and interested folks. The tool is written in Python if someone is willing to join, play with it and start contributing.

linsomniac2• 4 years ago

I played around with StackStorm maybe 5 years ago, but in the end I decided to use RunDeck instead. https://www.rundeck.com/. Used that for a few years but ended up abandoning it, but am thinking about resurrecting it, it was pretty good.

gzapp• 4 years ago

Ex-Rundeck engineer here. Would be very interested to here why you initially dropped it and why you are thinking about picking it back up!

linsomniac2• 4 years ago

It was just that we weren't using Rundeck very effectively. I set it up so that others could run a few Ansible jobs, and so that a slack bot could fire off one of those jobs. The Slack API changed a few years later and our old bot completely broke and I couldn't get it working again without rewriting. As far as other people running them, nobody else seemed to use it. So when it came time to upgrade the EOL OS that was hosting Rundeck, I just shut it down.

But, now we have some Jenkins jobs that would benefit from being isolated from Ansible runs, so Rundeck might be a good way to run those.

lgas2• 4 years ago

This is interesting. It's like IFTTT for ops. The list of adopters is intriguing too. I poked around their blog for a few minutes and it seemed to be targeted more at people who have already adopted StackStorm. It would be great to be able to read some success stories from the people using it.

eugenc4• 4 years ago

https://github.com/StackStorm/st2/blob/master/ADOPTERS.md includes a few more examples and use cases with the links.

lgas2• 4 years ago

Oh thanks, somehow I looked right at that and didn't process the fact that it was annotated with case studies and conference talks.

nyellin• 4 years ago

Nice to see this on here.

I founded a startup that does something similar for Kubernetes:

http://github.com/robusta-dev/robusta

We've seen a bit of StackStorm too with our users!

glitchcrab• 4 years ago

Interesting. I saw this tweet (https://twitter.com/RobustaDev/status/1595767655687913473) last night, and I'm not sure that the image of people falling out of an airplane is in particularly good taste. It put me off your company and product immediately.

candiddevmike• 4 years ago

If you're looking for a similar, commercially supported product, checkout RackN Digital Rebar: https://www.rackn.com. Similar concept, vastly easier deployment/HA/GitOps/multi-tenancy story.

armab• 4 years ago

StackStorm was an open-core project with a paid enterprise offering on top of it, belonging to a single vendor. In 2019 the project was donated to the Linux Foundation as a neutral umbrella, also open-sourcing the enterprise features like RBAC, LDAP, UI Workflow Designer.

Today StackStorm has an open-source ecosysem with several partner companies (5) providing consulting, commercial support, custom solutions or training for the clients that may need it: https://stackstorm.com/partners/

These partners also contribute back to the core and help supporting the project together with the other maintainers.

debarshri3• 4 years ago

Stackstorm has been around since 2014 [1].

Rundeck is another closest competitors that worth mentioning. Things have evolved a lot in the ops space since then.

With advent of container orchestration of the operational automation pieces have also moved to the orchestration layer. There have been quite some new tools in the space I have been tracking for instance Fylament [2] which got acquired by netapp, blinkops etc. Post rendezvous with this domain, some bigger problems most of the major framework tools like this have is that, it is very hard to get started. There are lot of pre-requisites given the nature of the ops automation, this leads to a problem where it is very hard to active a customer. Secondly, these frameworks are always competing with it is bash/python script deployed with some container orchestration or some cronjobs. I have also seen people write CRDs and reconciliation loops in k8s doing lot of the tasks these automation frameworks would do.

[1] https://en.wikipedia.org/wiki/StackStorm

[2] https://www.netapp.com/newsroom/press-releases/news-rel-2022...

chillfox4• 4 years ago

Every time I need to automate something and I look at these solutions it becomes clear that I can put together a Ruby script to handle it much faster than getting one of these automation solutions up and running.

debarshri3• 4 years ago

I agree that writing a ruby script is tempting. Where I disagree with you is that, when you have an organisation of 100s of devs, these scripts become tech debt. You need to have standard operating procedures delivered via one platform, that's when rundeck et al plays an important role.

zyphr• 4 years ago

Red Hat is working towards a similar feature for anisble automation platform.

https://www.ansible.com/blog/getting-started-with-event-driv...

kinow• 4 years ago

I tested StackStorm sometime ago to confirm you can have cycles in the workflow graph: https://kinoshita.eti.br/2021/10/01/cyclic-workflows-with-cy...

I work with climate and weather workflows, where cycles in workflows are common (ecFlow and Cylc are popular tools that support it).

Haven't checked in a while but I expect StackStorm's Orchesta engine to have even more interesting features now.

marcrosoft• 4 years ago

I wouldn’t trust any tool that claims to have anything to do with security that has a curl pipe to bash install advertised.

eugenc4• 4 years ago

One of the maintainers here and I second that.

Other options available:

  - deb/rpm packages
  - Vagrant
  - Docker-compose
  - Ansible/Puppet
  - Kubernetes/Helm

https://docs.stackstorm.com/install/index.html

ilyt2• 4 years ago

...probably better idea to adveritse docker container, not everyone wants to have half-rotten corpse of python app spreading shit around your system forever (there is never an uninstall...) just to test something.

...or at least one that fucking works

    zzz@hydra:~$ curl -sSL https://stackstorm.com/packages/install.sh | bash -s -- --user=st2admin --password=Ch@ngeMe
    *** Detected Distro is Debian ***
    *** Detected flavor bookworm ***
    Unsupported ubuntu codename bookworm. Please use 16.04 (xenial) or Ubuntu 18.04 (bionic) or Ubuntu 20.04 (focal) as base system!

I've tried to drop the check for distro only to be asked for fucking sudo which is like... WTF ?

    zzz@hydra:/tmp$  ./install.sh --user=st2admin --password=Ch@ngeMe
    *** Detected Distro is Debian ***
    *** Detected flavor bookworm ***
    Downloading deployment script from: https://raw.githubusercontent.com/StackStorm/st2-packages/v3.8/scripts/st2bootstrap-deb.sh...
    Running deployment script for st2 ...
    OS specific script cmd: bash st2bootstrap-deb.sh  --stable   --user=st2admin --password=****
    [sudo] password for zzz:

curl|sh that downloads more curl|sh is also interesting choice.

ilyt2• 4 years ago

I've tried on clean account

It is curl|sh that also requires sudo

letsg0• 4 years ago

I wouldn't recommend it as a security tool

Works well for DevOps and SRE operations and like K8s, needs a whole team to run it

v3ss0n• 4 years ago

How it compares to:

- Prefect.io

- Apache Airflow

- Ansible Tower

eugenc4• 4 years ago

Prefect and Apache Airflow defines logic in a pure Python code, while StackStorm uses a YAML-structured Workflow called Orquesta [1] supporting different logic patterns (parallel, merge, concurrency, join, retries, pause, ask, nested subworkflows, etc) [2] with Jinja and YAQL [3] support. YAQL is especially interesting one where Jinja is not enough.

There's also a bi-directional ChatOps framework you can tie with the workflows to make the experience more interactive.

So you can listen on events (could be a chat command) from 3rd party services, do some rule filtering & matching (all in YAML), and trigger workflows with the logic that runs actions in other tool(s) and service(s).

StackStorm has Exchange [4], - a collection of 100+ plugin integrations with different tools and services contributed and supported by community to make that building blocks juggling easier.

[1] https://docs.stackstorm.com/orquesta/index.html

[2] https://github.com/StackStorm/st2/tree/master/contrib/exampl...

[3] https://yaql.readthedocs.io/en/latest/

[4] https://exchange.stackstorm.org/

StackStorm: Event-driven automation

Related Stories