SCEP 2015

Stream and Complex Event Processing PhD Course 2015

This is the official page of the PhD course on Stream and Complex Event Processing offered by Politecnico di Milano in 2015.

Proposers

Emanuele Della Valle, Gianpaolo Cugola, and Alessandro Margara

Short Description

An increasing number of distributed applications requires processing continuously flowing data from geographically distributed sources at
unpredictable rate to obtain timely responses to complex queries. Examples of such applications come from the most disparate fields: Smart Cities, Social Media Analytics, Sensor Networks, Security, Intelligent Business management, Agile Enterprises, Robotics.

These requirements led to the development of a number of systems specifically designed to process information as a flow. In particular, two models emerged and are today competing: the data stream processing model [1] and the complex event processing model [2]. More recently, the community working on Semantic Web Technologies has proposed his own contribution to the area in the form of stream reasoning systems [3,5].

The course aims at presenting the state of the art of the field and the most recent research results in stream and complex event processing. A particular emphasis will be given to the research conducted at DEI. The students will gain enough background on the topics to be able to use the tools made available by the academic and industrial community to solve prototypical problems. The exams will consist in reporting the experience in using the tools and in discussing the different trade-offs offered by them.

Program

  1. History and principles of stream computing and complex event processing [slides]
    • Description of the area
    • Typical applications
    • Challenges
  2. A modeling framework for DSMS and CEP [4][slides]
    • Functional model
    • Processing model
    • Deployment model
    • Interaction model
    • Data model
    • Time model
    • Rule model
    • Language model
  3. The realm of stream reasoning [5,6]
    • A brief introduction to the semantic Web technologies [slides]
    • From data streaming processing to stream reasoning [slides]
  4. The “operator placement” problem [slides]
    • Theory
    • Algorithms
  5. Programming language integration: reactive programming [slides]
    • Principles
    • Implementations: DREAM, Reactive Extensions (Rx)
  6. Discovering existing systems
  7. Putting it all together for the final evaluation
    • A practical scenario to test information flow processing systems [slides]
    • Experience report

Exam

Students are expected to put together what was taught in the course by

  • implementing a partial solution to ACM DEBS grand challenge 2015 using a tool you choose (e.g., one of the tools illustrated), and
  • reporting on their experience in the session dedicated to student reporting (14.9.2015).

More details were provided during June 30, 2015 session (see the slides).

Tools

  • Presented during the lessons

Calendar

  • June 4, 2015 (9.15 – 12.15) – Sala Seminari – ground floor – ed. 20: topics 1 and 2
  • June 12, 2015 (10.15 – 12.15) – Sala Seminari – ground floor – ed. 20: topic 4
  • June 15, 2015 (10.15 – 12.15) – Sala Conferenze – ground floor – ed. 20: topic 5
  • June 23, 2015 (9.15 – 11.15) – Sala Seminari – ground floor – ed. 20: topic 6.1
  • June 29, 2015 (9.15 – 13.15) – Sala Seminari – ground floor – ed. 20: topic 3
  • June 29, 2015 (14.15 – 16.15) – Sala Seminari – ground floor – ed. 20: topic 6.2
  • June 30, 2015 (13.15 – 16:15) – Sala Seminari – ground floor – ed. 20: topics 6.3 and 7
  • NEW September 14, 2015 (14.00 – 15.30) – PT1 – ground floor – ed. 20: Student reporting session (10-15 minutes per person)

References

[1] Brian Babcock, Shivnath Babu, Mayur Datar, Rajeev Motwani, and Jennifer
Widom. Models and issues in data stream systems. In PODS 2002: Proceedings of
the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database
systems, pages 1-16, New York, NY, USA, 2002. ACM.

[2] David C. Luckham. The Power of Events: An Introduction to Complex Event
Processing in Distributed Enterprise Systems
. Addison-Wesley Longman
Publishing Co., Inc., Boston, MA, USA, 2001.

[3] Emanuele Della Valle, Stefano Ceri, Frank van Harmelen, Dieter Fensel: It’s a Streaming World! Reasoning upon Rapidly Changing Information. IEEE Intelligent Systems 24(6): 83-89 (2009)

[4] Gianpaolo Cugola and Alessandro Margara. Processing flows of information:
From data stream to complex event processing
. ACM Computing Surveys,
44(3):15, June 2012.

[5] Alessandro Margara, Jacopo Urbani, Frank van Harmelen, Henri E. Bal:
Streaming the Web: Reasoning over dynamic data. J. Web Sem. 25: 24-44 (2014)

[6] http://streamreasoning.org/