Apama (software)

Apama is a complex event processing (CEP) and event stream processing (ESP) engine, developed by Software AG. Apama serves as a platform for performing streaming analytics over a range of high volume/low latency inputs and applications, such as IoT devices, financial exchanges, fraud detection, social media and similar.[2] Users can define data patterns to listen for and actions to take when these patterns are found, which are defined in the provided domain-specific language called the Event Processing Language (EPL). The core Apama engine is written in C++; the process can also optionally contain a JVM for interacting with user created Java code. Apama focuses on high throughput, low latency and memory efficient performance; used in both Intel benchmarks[3] and smaller machines such as the Raspberry Pi,[4] routers and other Edge/IoT[5] devices. It is particularly noteworthy within the CEP space as being one of the earliest projects, a long term market leader,[6][7][8][9] and innovator of many patents.[10][11][12][13][14][15][16][17]

APAMA
Developer(s)Software AG
Stable release
10.5.3 / June 26, 2020 (2020-06-26)[1]
Written inC++ and Java
Operating systemWindows, Linux
TypeComplex event processing, Event stream processing, IoT, Data analytics
LicenseCommercial / Freemium
Websiteapamacommunity.com

History

Apama Ltd. was founded in 1999 by Dr John Bates, Dr Giles Nelson and Dr Mohamad Afshar, who met while undertaking research at the Cambridge University Department of Computer Science and Technology.

In 2005, Apama Limited was acquired by Progress Software for $25 million.[18]

In 2013, Apama was acquired by Software AG from Progress for an undisclosed amount.[19]

In 2016, a freemium version, Apama Community Edition, was released,[20] alongside supporting forums and GitHub spaces.

Overview

Event Processing Language

Applications for Apama are authored in the Event Processing Language (EPL). EPL contains language features designed purely for Event Driven Programming,[21] including:

  • Events - Simple data structures containing fields and actions
  • Monitors - Similar to classes in other languages, monitors contain listeners and actions and are loaded upon injection
  • Listeners - Declarative patterns defining interesting conditions/combinations of events. Aggregation, temporal and filtering operators are supported
  • Actions - Imperative functions, usually run by listeners upon activation or monitors upon load
  • Contexts - Similar to threads, monitors exist inside contexts
  • Channels - Mechanism for communicating between contexts and external systems
  • Streams - Ordered partitions of events with support for aggregation and SQL-like queries

The EPL C++/Java-like syntax is designed to create CEP applications succinctly in conjunction with the above features, an example of which can be found below:

event MyEvent {
    integer myInt;
    sequence<string> myListOfStrings;
    boolean myBool;
}
 
monitor MyMonitor {
    action onload() {
        spawn worker() to context("mySideThread");
    }
 
    action worker() {
        on all MyEvent(myInt>10) as myCoassignedEvent -> MyEvent(myInt>20) or MyEvent(myBool=true) within 30.0 {
            if(doWork(myCoassignedEvent.myListOfStrings) != true) {
                log "Problem!";
            }
        }
    }
 
    action doWork(sequence<string>) returns boolean {
        // do work on the list
        return true;
    }
}

Apama Queries

Apama Queries is an alternate language for creating rules over defined data sets, such as the past five minutes of received data or past twenty events received, in an automatically multi-threaded environment that scales across machines. Apama Queries are better suited for monitoring very large sets, such as bank transactions. Typically, each entity (i.e. account holder) will be partitioned and processed independently of the rest of the set. Queries and Monitors can communicate via channels. An example of the previous scenario can be found below:

query FindSuspiciousWithdrawals {
    parameters {
        float DURATION;
        float THRESHOLD;
    }
 
    inputs {
        Withdrawal() key cardNumber within DURATION;
    }
 
    find every Withdrawal as w
        where w.amount > 100
        select last(w.transactionId) as tid
        select last(w.cardNumber) as cid
        having last(w.amount) > THRESHOLD * avg(w.amount) {
            send SuspiciousTransaction(tid, cid) to SuspiciousTransactionManager;
        }
}

Designer

The Software AG Designer is an Eclipse based IDE with special support for developing and deploying Apama applications, which is included in a standard installation. Features include code assistance, package management, profiling, GUI development and deployment management.

Plugins

Apama supports the ability for users to create plugins to extend capability. These plugins come in two forms, EPL plugins (to add features to EPL) and Connectivity plugins (for communicating with the outside world). C++ and Java APIs are available for both plugin types. Connectivity plugins come in two forms, codecs (which translate data from one format to another, such as the internal Apama representation to JSON) and transports (which handle sending/receiving to/from external systems, such as JMS). Connections to external systems are made by composing chains of codecs and one transport to achieve the desired topology; these connections are defined by a YAML configuration file at start-up or through dynamic management with the provided tools. Several pre-built plugins for popular technologies (e.g. R, MQTT, Kafka, HTTP, MatLab) as well as connectivity to other Software AG products (e.g. Universal Messaging, Terracotta, Cumulocity) are shipped with Apama installations.

Persistence

The Apama process is entirely in memory and supports an optional SQLite based in-built persistence system. Additionally, the connectivity API supports reliable messaging to systems that support it, such as JMS. Finally, a pre-built distributed memory store plugin is provided with standard installations for use with appropriate back-ends.

Visualization

Apama provides an in-built dashboarding technology developed from within the Software AG Designer, as well as native connections to Software AG's MashZone NextGen.

See also

References

  1. "Apama Community Edition New release". apamacommunity.com. Retrieved 2021-03-25.
  2. "Apama Streaming Analytics & Event Processing Platform". Retrieved 2018-01-16.
  3. "Apama Streaming Analytics* with the Intel® Xeon® Processor E7 v3". Intel. Retrieved 2018-01-16.
  4. "Apama Community Edition Apama 9.12 Community Edition release announcement". www.apamacommunity.com. Retrieved 2018-01-16.
  5. "Software AG introduces Apama EagleEye for an updated, AI-enabled market surveillance solution - IoT Now - How to run an IoT enabled business". IoT Now - How to run an IoT enabled business. 2017-11-23. Retrieved 2018-01-16.
  6. "Sell-Side Technology Awards 2013: Best Sell-Side Complex-Event Processing (CEP) Technology ─ Progress Apama - WatersTechnology.com". WatersTechnology.com. 2013-06-03. Retrieved 2018-02-08.
  7. "Magic Quadrant for Intelligent Business Process Management Suites". www.gartner.com. Retrieved 2018-01-19.
  8. "The Forrester Wave™: Streaming Analytics, Q3 2017". www.forrester.com. Retrieved 2018-01-19.
  9. "Streaming analytics platforms – Bloor Research". www.bloorresearch.com. Retrieved 2018-01-19.
  10. US 20020128897, Nelson, Giles & Bates, John, "Method and apparatus for evaluating queries against received event information", published 12 Sep 2002
  11. US 9009234, Mitchell, Robert Scott; Horsburgh, Mark K. & Bentley, Richard M., "Complex event processing system having multiple redundant event processing engines", published 14 Apr 2015
  12. US 8656350, Bates, John; Smith, Gareth & Bentley, Richard M., "Event-based process configuration", published 18 Feb 2014
  13. US 8640089, Bates, John; Smith, Gareth & Bentley, Richard M., "Automated construction and deployment of complex event processing applications and business activity monitoring dashboards", published 28 Jan 2014
  14. US 9400692, Reed, Christopher & Horsburgh, Mark, "System and method for managing the allocating and freeing of objects in a multi-threaded system", published 26 Jul 2016
  15. US 20160048914, Smith, Gareth, "Trade surveillance and monitoring systems and/or methods", published 18 Feb 2016
  16. US 20160019608, Smith, Gareth, "Dynamically adaptable real-time customer experience manager and/or associated method", published 21 Jan 2016
  17. US 9449218, SMITH, Leighton & Smith, Gareth, "Large venue surveillance and reaction systems and methods using dynamically analyzed emotional input", published 20 Sep 2016
  18. "Progress Software Announces Acquisition of Apama". Retrieved 2018-01-16.
  19. "Progress Software Announces Agreement to Sell Apama Solution to Software AG (NASDAQ:PRGS)". investors.progress.com. Archived from the original on 2018-02-09. Retrieved 2018-01-16.
  20. "Apama Community Edition Introducing Apama Community Edition". www.apamacommunity.com. Retrieved 2018-01-16.
  21. "The Apama Platform" (PDF). Archived from the original (PDF) on 2019-12-21. Retrieved 2023-08-04.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.