qindongliang/streaming-offset-to-zk

This system is a Kafka-based streaming application designed to process data streams with automatic offset management for partition scalability. It incorporates robust operational controls, including graceful shutdown mechanisms via HTTP endpoints and HDFS file triggers. The codebase also manages dependencies for Elasticsearch and Fastjson to support its data processing and storage requirements.

The streaming application now supports two new graceful shutdown strategies: an HTTP endpoint on port 5555 that triggers a clean stop when accessed, and a background scanner that checks for a specific HDFS file to trigger termination. Additionally, the offset management logic has been updated to automatically detect and initialize offsets for newly added Kafka partitions when a streaming application restarts, ensuring continuity without manual intervention.

src/main · high confidence

The project's dependency versions have been updated in pom.xml. The Elasticsearch client library has been upgraded from version 2.3.4 to 8.19.8, and the Fastjson library has been updated from version 1.2.15 to 1.2.83.

(dependencies) · high confidence

Written by watchdog.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

• First survey — no prior run to compare against. CAI 40.

• Code Health 100
• Architecture 69
• Maturity 36
• Readiness 17
• Security 100

• 34 commits — 34 feature/other, 0 fixes

• (root) — 24 commits
• (repo) — 7 commits
• src/main — 3 commits

• change: Bump fastjson from 1.2.31 to 1.2.83
• change: Bump org.elasticsearch:elasticsearch from 7.17.13 to 7.17.19
• change: Bump org.elasticsearch:elasticsearch from 7.17.19 to 7.17.23
• change: Bump org.elasticsearch:elasticsearch from 7.17.23 to 8.15.1
• change: Bump org.elasticsearch:elasticsearch from 8.15.1 to 8.18.8
• change: Bump org.elasticsearch:elasticsearch from 8.18.8 to 8.19.8
• change: Create LICENSE
• change: Create README.md
• change: Merge branch 'master' of https://github.com/qindongliang/streaming-offset-to-zk
• change: Merge pull request #11 from qindongliang/dependabot/maven/com.alibaba-fastjson-1.2.83
• change: Merge pull request #12 from qindongliang/dependabot/maven/org.elasticsearch-elasticsearch-7.17.19
• change: Merge pull request #13 from qindongliang/dependabot/maven/org.elasticsearch-elasticsearch-7.17.23
• change: Merge pull request #14 from qindongliang/dependabot/maven/org.elasticsearch-elasticsearch-8.15.1
• change: Merge pull request #16 from qindongliang/dependabot/maven/org.elasticsearch-elasticsearch-8.18.8
• change: Merge pull request #17 from qindongliang/dependabot/maven/org.elasticsearch-elasticsearch-8.19.8
• change: Update README.md
• change: Update README.md
• change: Update README.md
• change: Update README.md
• change: Update README.md
• …and 14 more

Written by watchdog.canine.dev from the codebase's own history, inside the signed delivery this page is composed from.

qindongliang/streaming-offset-to-zk was measured the same way every project in this corpus was: the same rubric, at a pinned commit, with the result published in full. Point a surveyor at a repository you know and see whether you agree with it.