Onyx 0.9.7-beta1 发布了。 Onyx 是一个无中心、支持云、容错的分布式计算系统,使用 Clojure 编写,支持批处理和流处理混合,提供信息模型用于描述和构建分布式工作流。 主要用途: 实时的事件流处理 连续计算 ETL 在 MapReduce 进行数据转换 数据清理 数据摄入和存储媒介传输 该版本只是一个测试版本,暂无相关更新记录,预计正式版有如下更新: Bug fix: Fixed suppressed exceptions on with-test-env start up sequence. Bug fix: Fixed schema merging for task bundles. Bug fix: Suppress Aeron MediaDriver NoSuchFileException when Aeron cleans up the directory before we do. Bug fix: Fixed ZooKeeper thread leak bug. #600 Bug fix: Fixed logging statement echoing the number of processed segments. Bug fix: Only allow peer to write one exhausted input log entry per task. #493 Bug fix: Fixed bug in percentage scheduler that failed to use all available peers due to a rounding error. Documentation fix: Fixed lifecycles exception description. Documentation fix: Fixed trigger predicate signature description. #586 Documentation: Added more content to the FAQ section. Dependency change: Upgraded org.btrplace/scheduler-api to 0.46. Dependency change: Upgraded org.btrplace/scheduler-choco to 0.46. Dependency change: Excluded ClojureScript from clj-fuzzy dependencies. Design change: Implemented peer-group ZooKeeper connection sharing. This reduces the number of ZooKeeper connections required per machine, and improves scheduler performance. Enhancement: Tasks now time out when being stopped, allowing a peer to be rescheduled in cases where the task is stuck. This is configured via the peer-config nyx.peer/stop-task-timeout-ms. Enhancement: A message is now emitted to the logs when a job is submitted, but does not start because of the scheduler gave it no peers. 更多详情,可以在这里查看。 下载地址: Source code (zip) Source code (tar.gz) Onyx 0.9.7-beta1 发布,分布式计算系统下载地址