Streaming and Events APIs
Thursday, October 28, 2021
Today, data is being generated from devices and containers living at the edge of networks, clouds and data centers. We need to run business logic, analytics and deep learning at the edge before we start our real-time streaming flows. Fortunately using the all Apache FLiP stack we can do this with ease! Streaming AI Powered Analytics From the Edge to the Data Center is now a simple use case. With MiNiFi we can ingest the data, do data checks, cleansing, run machine learning and deep learning models and route our data in real-time to Apache NiFi and/or Apache Pulsar for further transformations and processing. Apache Flink will provide our advanced streaming capabilities fed real-time via Apache Pulsar topics. Apache MXNet models will run both at the edge and in our data centers via Apache NiFi and MiNiFi.
Event-driven architectures are not new - but the way they are used, documented, and specified has matured significantly in the past few years. The drivers behind the EDA Revolution are varied: the explosion of microservices, the advent of 'real-time' interaction models, and the creation of tooling and specifications to design, document, govern, implement, test, and monitor event-driven systems. What can we learn from our journey with RESTful APIs about the future of event-driven architecture in our organizations? What role do asynchronous services play in delivering value in our organizations?