Skip to content

feat: zulip progress tracking#853

Draft
deardarlingoose wants to merge 2 commits intomainfrom
feat/dag-zulip
Draft

feat: zulip progress tracking#853
deardarlingoose wants to merge 2 commits intomainfrom
feat/dag-zulip

Conversation

@deardarlingoose
Copy link
Contributor

@deardarlingoose deardarlingoose commented Feb 9, 2026

business goals:

  • Intermittent errors cause internal users to lose trust
  • dev team doesn't see the errors fast enough
  • internal users don't see progress

alternatives considered:

  • standard error reporting - we have it anyways, it works and is good alternative, isn't as fast and obvious to check the specific class of errors at glance
  • in-ui progress - we should and will have it, it's just much more design-heavy goal than printing text into chatbot

changes

  • progress print generic module, hatchet workflow structure-independently prints current progress into .md, flattening the graph into text
  • zulip update module, printing the current progresses / updating the messages on progress into set up zulip channel

env vars

Variable Description Example
ZULIP_DAG_STREAM Zulip stream where DAG status messages are posted general
ZULIP_DAG_TOPIC Topic within the stream for DAG status messages dag-status
ZULIP_HOST_HEADER Override Host header for Zulip API requests (needed when Docker internal hostname differs from Zulip's ALLOWED_HOSTS) zulip.localhost
Screenshot 2026-02-09 at 10 58 09 AM

Cherry-picked from feat/hatchet-run-renderer branch.
Post a rendered DAG status message to a configurable Zulip stream/topic
when a Hatchet workflow is dispatched. Update it after each task
completes (success or failure), and delete it when post_zulip runs
so the final transcript notification replaces it.

On pipeline failure, appends an error banner (:cross_mark:) with the
failing step name and error message.

New settings: ZULIP_DAG_STREAM, ZULIP_DAG_TOPIC, ZULIP_HOST_HEADER.
New module: reflector/hatchet/dag_zulip.py (create/update/delete).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants