1. XenForo 1.5.14 中文版——支持中文搜索!现已发布!查看详情
  2. Xenforo 爱好者讨论群:215909318 XenForo专区

新闻 Onyx 0.9.0 发布,分布式计算系统 下载

本帖由 漂亮的石头2016-03-24 发布。版面名称:软件资讯

  1. 漂亮的石头

    漂亮的石头 版主 管理成员

    注册:
    2012-02-10
    帖子:
    487,536
    赞:
    47
    Onyx 0.9.0 发布了。

    Onyx 是什么?


    • Onyx 是一个无中心、支持云、容错的分布式计算系统


    • 使用 Clojure 编写


    • 支持批处理和流处理混合


    • 提供信息模型用于描述和构建分布式工作流




    • 竞争对手: Storm, Cascading, Map/Reduce, Dryad, Apache Sqoop, Twitter Crane 等等
    用途?


    • 实时的事件流处理


    • 连续计算


    • ETL


    • 在 MapReduce 进行数据转换


    • 数据清理


    • 数据摄入和存储媒介传输

    此版本更新如下:


    • API breaking change: onyx/id in peer-config and env-config was renamed to :eek:nyx/tenancy-id


    • API breaking change: :aggregation/fn was renamed to :aggregation/create-state-update.


    • API breaking change: changed the signatures of: :aggregation/init, :aggregation/create-state-update, :aggregation/apply-state-update, and :aggregation/super-aggregation-fn. All now take the window as the first argument.


    • API breaking change: internal messaging functions no longer take the event map as an argument. Note, this will break any plugins that manually manage the ack count, such as plugins using async callbacks.


    • API breaking change: triggers and refinements functions are now resolved to vars via namespace lookup e.g. Trigger example: :trigger/on :segment -> :trigger/on :eek:nyx.triggers/segment, Refinement example: :trigger/refinement :accumulating -> :trigger/refinement :eek:nyx.refinements/accumulating,


    • Breaking change in onyx-metrics: :metrics/workflow-name was deprecated in favor of metadata map. See onyx-metrics changes


    • Bug fix: fixed exceptions losing their main .getCause message when thrown inside a lifecycle


    • New feature: Jobs now support metadata by including a metadata map with job submission data e.g. {:workflow ... :catalog ... :job-metadata {:name "myjobname"}}. This makes it easier to correlate information about jobs, query the cluster for jobs, etc.


    • Design change: Implemented trigger refinements in terms of state updates. In order to implement a refinement, one must now implement a refinement calls map, analagous to the aggregation calls map. This takes the form {:refinement/create-state-update (fn [trigger state state-event]) :refinement/apply-state-update (fn [trigger state entry])}


    • Enhancement: Lifecycles can now catch flow condition exceptions through :lifeycycle/handle-exception from the :lifecycle/execute-flow-conditions and :lifecycle/apply-fn phases.


    • Enhancement: loosened the peer configuration schema needed for log subscription


    • Dependency change: Upgraded org.clojure/clojure to 1.8.0

    下载地址:

    Onyx 0.9.0 发布,分布式计算系统下载地址
     
正在加载...