Data Dissemination Supporting Complex Event Pattern Detection

##plugins.themes.academic_pro.article.main##

Roberto Baldoni
Silvia Bonomi
Giorgia Lodi
Marco Platania
Leonardo Querzoni

Abstract

The increasing use of the Internet and the improvement in hardware technology led most of the application previously deployed in "closed" environments, such as business intelligence, smart environments, complex system software management, to federate into geographically-distributed systems. Such applications use "sense-and-respond" capabilities, i.e., they correlate basic events that could potentially occur at different sources and detect complex event patterns, in order to timely and properly react to changes that may happen within the system. In this context, a fundamental role is played by the data dissemination service that brings events from producers to consumers where complex event patterns are detected. In this paper we discuss the characteristics that a data dissemination service should have in order to support in the best way the complex event pattern detection functionality, and present an assessment of a number of technologies that can be used to disseminate data in the earlier mentioned context. We also describe how those technologies can be effectively deployed in scenarios where numerous independent data sources produce large amounts of events in the form of high-throughput streams. Finally, we present a matching between distributed application requirements and the capabilities offered by the data dissemination services used to implement them, highlighting which aspects should be considered in the design of novel middleware solutions to fill this gap.

##plugins.themes.academic_pro.article.details##

How to Cite
Roberto Baldoni, Silvia Bonomi, Giorgia Lodi, Marco Platania, & Leonardo Querzoni. (2011). Data Dissemination Supporting Complex Event Pattern Detection. International Journal of Next-Generation Computing, 2(3), 200–220. https://doi.org/10.47164/ijngc.v2i3.16

References

  1. Aniello, L., Luna, G. A. D., Lodi, G., and Baldoni, R. 2011. A collaborative event processing system for protection of critical infrastructures from cyber attacks. In Proceedings of the 30th Conference on System Safety, Reliability and Security. Napoli.
  2. Balazinska, M., Balakrishnan, H., and Stonebraker, M. 2004. Contract-based load management in federated distributed systems. In Proceedings of the 1st USENIX Symposium on Networked Systems Design and Implementation. 197–210.
  3. Baldoni, R., Beraldi, R., Tucci Piergiovanni, S., and Virgillito, A. 2005. On the modelling of publish/subscribe communication systems. Concurrency and Computation: Practice and Experience 17, 12, 1471– 1495.
  4. Baldoni, R., Contenti, M., Piergiovanni, S., and Virgillito, A. 2003. Modeling publish/subscribe communication systems: towards a formal approach. In Proceedings of the 8th International Workshop on Object Oriented Real-Time Dependable Systems. IEEE, 304–311.
  5. Baldoni, R., Querzoni, L., and Scipioni, S. 2008. Event-based data dissemination on inter-administrative domains: Is it viable? In Proceedings of the 12th IEEE International Workshop on Future Trends of Distributed Computing Systems. IEEE Computer Society, Washington, DC, USA, 44–50.
  6. Basin, D., Birman, K., Keidar, I., and Vigfusson, Y. 2010. Sources of instability in data center multicast. In Proceedings of the 4th International Workshop on Large Scale Distributed Systems and Middleware. ACM, 32–37.
  7. Birman, K. 2009. Rethinking multicast for massive-scale platforms. In Proceedings of the 29th IEEE International Conference on Distributed Computing Systems.
  8. Birman, K., Chockler, G., and van Renesse, R. 2009. Toward a cloud computing research agenda. SIGACT News 40, 2, 68–80.
  9. Birman, K. P. 1993. The process group approach to reliable distributed computing. Commun. ACM 36, 12, 36–53, 103.
  10. Birman, K. P. and Joseph, T. A. 1987. Exploiting virtual synchrony in distributed systems. In Proceedings of the 11th ACM Symposium on Operating System Principles. 123–138.
  11. CoMiFin. 2008. CoMiFin - Communication Middleware for Monitoring Financial Critical Infrastrucures. http: //www.comifin.eu/.
  12. Corsaro, A., Querzoni, L., Scipioni, S., Piergiovanni, S. T., and Virgillito, A. 2006. Quality of service in publish/subscribe middleware. In Global Data Management, R. Baldoni and G. Cortese, Eds. IOS Press.
  13. Costa, P. and Picco, G. P. 2005. Semi-probabilistic content-based publish-subscribe. In Proceedings of the 25th IEEE International Conference on Distributed Computing Systems. IEEE Computer Society, Washington, DC, USA, 575–585.
  14. Defago, X. , Schiper, A., and Urban, P. ´ 2004. Total order broadcast and multicast algorithms: Taxonomy and survey. ACM Computing Surveys (CSUR) 36, 4, 372–421.
  15. Demers, A., Greene, D., Hauser, C., Irish, W., Larson, J., Shenker, S., Sturgis, H., Swinehart, D., and Terry, D. 1987. Epidemic algorithms for replicated database maintenance. In Proceedings of the 6th annual ACM Symposium on Principles of distributed computing. ACM, 1–12.
  16. Deutzman, J. 2010. FBI investigates $9 Million ATM scam. http://www.myfoxny.com/dpp/news/090202_FBI_ Investigates_9_Million_ATM_Scam.
  17. Esper. 2009. Where Complex Event Processing meets Open Source: Esper and NEsper. http://esper.codehaus. org/.
  18. Esper. 2011. Esper time-order. http://esper.codehaus.org/esper-4.2.0/doc/reference/en/html_single/ index.html#view-time-order.
  19. Etzion, O. 2008. Event processing architecture and patterns. In Proceedings of the 2nd International Conference on Distributed Event Based Systems.
  20. Huang, Y., Feamser, N., Lakhina, A., and Xu, J. J. 2007. Diagnosing network disruptions with network-wide analysis. In SIGMETRICS’07. San Diego, California, USA.
  21. JBoss. 2010. JBoss Drools Fusion. http://www.jboss.org/drools/drools-fusion.html.
  22. JGroups. 2010. Jgroups - a toolkit for reliable multicast communication. http://www.jgroups.org//.
  23. Liebig, C., Cilia, M., and Buchmann, A. 1999. Event composition in time-dependent distributed systems. In Proceedings of the 4th IECIS International Conference on Cooperative Information Systems. IEEE Computer Society, Washington, DC, USA, 70.
  24. Lodi, G., Aniello, L., and Baldoni, R. 2011. Inter-domain stealthy port scan detection through complex event processing. In Proceedings of the 13th European Workshop on Dependable Computing. ACM, Pisa, 67–72.
  25. Lodi, G., Querzoni, L., Baldoni, R., Marchetti, M., Colajanni, M., Bortnikov, V., Chockler, G., Dekel, E., Laventman, G., and Roytman, A. 2009. Defending financial infrastructures through early warning systems: the intelligence cloud approach. In Proceedings of the 5th Annual Workshop on Cyber Security and Information Intelligence Research: Cyber Security and Information Intelligence Challenges and Strategies. ACM, 18. Microsystem, S. 2008. Java Message Service (JMS). http://java.sun.com/products/jms/. NESSI. 2009. NESSI Strategic Agenda.
  26. Palmer, M. and Dzmuran, M. 2009. An Introduction to Event Processing, white paper. http: //www.cnetdirectintl.com/direct/fr/2009/progress/0907_centre_ressources/ressources/1-1_LB_UK_ introduction_CEP.pdf.
  27. Pietzuch, P., Shand, B., and Bacon, J. 2004. Composite event detection as a generic middleware extension. Network, IEEE 18, 1, 44–55.
  28. Pietzuch, P. R. 2004. Hermes: A Scalable Event-Based Middleware. Ph.D. thesis, University of Cambridge. PrismTech Ltd. 2010. BLEND Box. http://www.prismtech.com/news/.
  29. Rao, S. K. 2010. Algorithmic trading: Pros and cons. http://www.tcs.com/SiteCollectionDocuments/ WhitePapers/TCS_FS_algorithmictrading.pdf.
  30. Shoup, R. 2007. Randy Shoup on eBay’s Architectural Principles. http://www.infoq.com/presentations/ shoup-ebay-architectural-principles.
  31. SM4All. 2008. SM4All Project - Smart Homes For All. http://www.sm4all-project.eu/.
  32. SOFIA. 2009. SOFIA Project - Smart Objects For Intelligent Applications. http://www.sofia-project.eu/.
  33. Van Renesse, R., Birman, K. P., and Vogels, W. 2003. Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Trans. Comput. Syst. 21, 2, 164–206.