1. XenForo 1.5.14 中文版——支持中文搜索!现已发布!查看详情
  2. Xenforo 爱好者讨论群:215909318 XenForo专区

新闻 Apache NiFi 0.2.0 发布,数据处理和分发系统 下载

本帖由 漂亮的石头2015-07-18 发布。版面名称:软件资讯

  1. 漂亮的石头

    漂亮的石头 版主 管理成员

    注册:
    2012-02-10
    帖子:
    487,336
    赞:
    47
    Apache NiFi 0.2.0 发布了,该项目目前还处于 Apache 基金会的孵化阶段。

    Apache NiFi 是一个易于使用、功能强大而且可靠的数据处理和分发系统。Apache NiFi 是为数据流设计。它支持高度可配置的指示图的数据路由、转换和系统中介逻辑。

    架构:

    [​IMG]

    集群管理器:

    [​IMG]

    主界面:

    [​IMG]

    关键特性包括:


    • 基于web的用户界面


      • 无缝体验设计、控制和监视

    • 高度可配置的


      • 数据丢失容错和保证交付


      • 低延迟和高吞吐量


      • 动态优先级


      • 流可以在运行时修改


      • 背压 Back presure

    • 数据来源


      • 从始至终跟踪数据流

    • 为扩展设计


      • 构建自己数据处理器


      • 支持快速开发和有效的测试

    • 安全


      • SSL,SSH,HTTPS加密内容,等等……


      • 可插拔的基于角色的验证/授权

    主要改进内容包括:

    Sub-task


    • [NIFI-626] - ExecuteSQL processor for executing arbitrary SQL queries
    Bug


    • [NIFI-16] - Site-to-site should use canonical hostnames when sending peer list


    • [NIFI-37] - If provenance receive/create/fork/join/clone event registered against flowfile not created in session...


    • [NIFI-41] - Shoud not be able to change destination of Connection if component has its FlowFiles


    • [NIFI-80] - When provenance repo retrieves an event that has attributes > some threshold, truncate the value


    • [NIFI-126] - Mock Framework should detect when session.create() called instead of session.create(FlowFile) / session.create(Collection<FlowFile>) without emitting CREATE/RECEIVE Provenance Event


    • [NIFI-129] - Root Group Ports show that they are not transmitting even when there are active threads receiving data


    • [NIFI-155] - Test Failure: MulticastProtocolListenerTest and ClusterServiceDiscoveryTest


    • [NIFI-230] - Volatile Content Repository shows negative values available in 'System Diagnostics'


    • [NIFI-313] - When template is deleted, UI still shows "Displaying X of Y" instead of "Displaying X of (Y-1)"


    • [NIFI-334] - When WriteAheadFlowFileRepo is restoring FlowFiles, it needs to look at the swapped flow files, Id's before setting the max id for the FlowFile ID.


    • [NIFI-373] - If NiFi UI is secure but cluster communication is not, NiFi doesn't start but throws NullPointer instead of nice error message


    • [NIFI-378] - MergeContent in Defragment mode will merge fragments without checking index


    • [NIFI-379] - MergeContent does not merge when Maximum number of Bins is set to 1


    • [NIFI-427] - Too many steps to delete flows


    • [NIFI-472] - When running NiFi with the "run.as" property specified in the bootstrap.conf file, the run.as user should own the nifi.pid file


    • [NIFI-482] - users are currently able to evaluate a function against the result of an aggregrate function


    • [NIFI-487] - JsonPath processors can mark valid JSON as invalid


    • [NIFI-488] - Bootstrap not capturing output stream or error stream


    • [NIFI-532] - Exception handling in RunNifi


    • [NIFI-545] - DataFlowDaoImpl writeDataFlow creates an unused dataflow


    • [NIFI-546] - StandardDataFlows constructor declears it throws NullPointerException but does not


    • [NIFI-547] - Data Viewer: Better support for Unicode characters


    • [NIFI-564] - ReplaceText not working as expected when forming POST requests for InvokeHTTP


    • [NIFI-565] - System-Level bulletins generated on nodes do not show in the UI when clustered


    • [NIFI-571] - Findbugs issue in StandardControllerServiceProvider


    • [NIFI-578] - FlowFileNode does not set clusterNodeIdentifier


    • [NIFI-580] - Typo in documentation for EncryptContent


    • [NIFI-582] - Inconsistent naming convention of IDs for the same component in NiFi UIs


    • [NIFI-591] - CompressContent uses wrong mime type for BZIP2


    • [NIFI-594] - TestExtractHL7Attributes writes to System output


    • [NIFI-602] - Error on shutdown bin/nifi.sh stop


    • [NIFI-613] - ScanContent throws exception on dictionary with blank line


    • [NIFI-625] - ReplaceText does not substitute Expression Language if embedded within curly braces


    • [NIFI-630] - Process Group ID


    • [NIFI-632] - Documentation Generation: Nar ClassLoader


    • [NIFI-633] - Documentation Generation: Logger


    • [NIFI-637] - Improve Nifi Windows Batch Scripts


    • [NIFI-638] - Rest API documentation is not clickable


    • [NIFI-643] - SplitJson creates a cycle of provenance events


    • [NIFI-647] - Duplicating provenance reporting via session creates unexpected behavior


    • [NIFI-657] - MongoDB unit tests fail


    • [NIFI-661] - Controller Services tab not showing resons for "Invalid" state in Firefox


    • [NIFI-662] - Unit test failures for ExecuteStreamCommand


    • [NIFI-663] - TestExecuteStreamCommand tests are not OS safe


    • [NIFI-664] - WebUI - Invalid argument to setTimeout when disabling ControllerServices


    • [NIFI-670] - Copying and pasting a processor using a controller service generates copies of the controller service


    • [NIFI-672] - Documentation: Admin Guide-Controlling Levels of Access example incorrect


    • [NIFI-674] - FileSystemRepository should not create new threads in its constructor


    • [NIFI-676] - DBCPService throws NPE if using OtherDB


    • [NIFI-677] - DBCPService should allow user to specify Connection URL


    • [NIFI-678] - DBCPService should not require password


    • [NIFI-682] - EvaluateXPath docs missing closing parenthesis


    • [NIFI-683] - When connecting to cluster, splash screen remains indefinitely if error sent back


    • [NIFI-691] - Default config causes NiFi to stop processing after a while if more than 50% of disk used


    • [NIFI-693] - Cannot download template


    • [NIFI-694] - If Enabling Controller Service fails, no indication is provided to user


    • [NIFI-695] - Cancel Enable/Disable controller service should provide immediate feedback to user


    • [NIFI-699] - Remove Enable checkbox from Controller Service Configuration Dialog


    • [NIFI-701] - Downloaded templates are missing ControllerServices


    • [NIFI-702] - PutFile writes too much data when used with VolatileContentRepository


    • [NIFI-703] - When calling Session.get(int), it's possible to not get any FlowFiles even when queue is not empty


    • [NIFI-705] - TestHandleHttpRequest#testRequestAddedToService fails in Ubuntu 14.04


    • [NIFI-711] - Exception thrown when routing FlowFile to multiple connections


    • [NIFI-717] - nifi-bootstrap.log written to directory relative to current working directory


    • [NIFI-718] - nifi.sh install does not properly install nifi as a linux service


    • [NIFI-719] - For Reporting Tasks, ConfigurationContext should provide scheduling information


    • [NIFI-720] - If Reporting Task fails to start properly and is then stopped, it can continue to run once it is able to start


    • [NIFI-721] - Typos in ExtractText


    • [NIFI-722] - Reporting Task Run Schedule


    • [NIFI-728] - Unit test failure on multi-core/fast system builds: nifi-distributed-cache-server


    • [NIFI-731] - If content repo is unable to destroy content as fast as it is generated, nifi performance becomes very erratic


    • [NIFI-733] - GetKafka group identifier is ignored


    • [NIFI-734] - GetKafka Kafka Timeout property is ignored


    • [NIFI-735] - DocGenerator should call @OnShutdown after its done generating the docs


    • [NIFI-738] - Do not write conversion error messages to flow file content


    • [NIFI-743] - .getSolr-mock-processor and .httpCache-mock-processor files in conf dir


    • [NIFI-745] - Disabling Controller Service stuck


    • [NIFI-749] - Unit tests fail on Windows for InvokeHTTP


    • [NIFI-753] - NPE when reading in provenance data
    Improvement


    • [NIFI-75] - Mock Framework should fail if session.create() used and no appropriate prov event created...


    • [NIFI-349] - NiFi should set namespaceAware flag on document builders


    • [NIFI-413] - KafkaPut should support compression option


    • [NIFI-419] - SSLContextService should allow configurable TLS version


    • [NIFI-454] - Distributed cache server unit tests should use random ports


    • [NIFI-548] - Listen UDP should support generation of a flowfile per datagram


    • [NIFI-551] - Improve error handling for ConvertJSONToAvro processor


    • [NIFI-553] - Remove experimental tag from some processors


    • [NIFI-583] - Provide ExecuteStreamCommand option of streaming contents over STDIN of an incoming flowfile


    • [NIFI-600] - Add compression support to PutHDFS and GetHDFS


    • [NIFI-606] - Add a NiFi Storm Spout


    • [NIFI-618] - Allow components to be taken out of a processor group


    • [NIFI-642] - Eliminate hardcoded HDFS compression codec classnames.


    • [NIFI-644] - Data Viewer: Use mime.type when known


    • [NIFI-645] - Set content archive and content viewer on by default


    • [NIFI-654] - Update dependency versions


    • [NIFI-679] - InvokeHTTP - Add support for basic authentication


    • [NIFI-680] - Processor docs don't always need to mention Sensitive properties or EL


    • [NIFI-685] - Proxy Support for GetHTTP and PostHTTP processors


    • [NIFI-704] - StandardProcessorTestRunner should allow you to wait before calling OnUnScheduled methods


    • [NIFI-707] - GetHTTP should set mime.type attribute based on HTTP Content-Type header


    • [NIFI-724] - Controller Services and Reporting Tasks should be able to emit bulletins


    • [NIFI-737] - Typo in developer guide 'lot message'


    • [NIFI-750] - NiFi Storm Spout should allow FlowFile attributes to be put into Tuple values
    New Feature


    • [NIFI-322] - New Database Connection Pooling Controller Service


    • [NIFI-570] - MongoDB Processors


    • [NIFI-601] - Use dynamic properties as environment variables in ExecuteStreamCommand
    Task


    • [NIFI-584] - Remove javadoc author tags


    • [NIFI-656] - Release Manager: Release 0.2.0


    • [NIFI-659] - rat-plugin needs to be configured to exclude child and parent items
    Apache NiFi 0.2.0 发布,数据处理和分发系统下载地址
     
正在加载...