SCEP2013

PhD Course on Stream and Complex Event Processing at Politecnico di Milano

This is the official page of the PhD course on Stream and Complex Event Processing offered by Politecnico di Milano in 2013.

Proposers

Emanuele Della Valle, Gianpaolo Cugola, and Alessandro Margara

Short Description

An increasing number of distributed applications requires processing continuously flowing data from geographically distributed sources at
unpredictable rate to obtain timely responses to complex queries. Examples of such applications come from the most disparate fields: Smart Cities, Social Media Analytics, Sensor Networks, Security, Intelligent Business management, Agile Enterprises, Robotics.

These requirements led to the development of a number of systems specifically designed to process information as a flow. In particular, two models emerged and are today competing: the data stream processing model [1] and the complex event processing model [2]. More recently, the community working on Semantic Web Technologies has proposed his own contribution to the area in the form of
stream reasoning systems [3].

The course aims at presenting the state of the art of the field and the most recent research results in stream and complex event processing. A particular emphasis will be given to the research conducted at DEI. The students will gain enough background on the topics to be able to use the tools made available by the academic and industrial community to solve prototypical problems. The exams will consist in reporting the experience in using the tools and in discussing the different trade-offs offered by them.

Program

  1. History and principles of stream computing and complex event processing [slides]
    • Description of the area
    • Typical applications
    • Challenges
  2. A modeling framework for DSMS and CEP [4][slides]
    • Functional model
    • Processing model
    • Deployment model
    • Interaction model
    • Data model
    • Time model
    • Rule model
    • Language model
  3. The realm of stream reasoning [5]
    • A brief introduction to the semantic Web technologies [slides]
    • From data streaming processing to stream reasoning [slides]
  4. The “operator placement” problem [slides]
    • Theory
    • Algorithms
  5. On managing uncertainty in data and rules [slide]
    • A model of uncertainty for information flow processing systems
  6. Learning From the Past: Automatic Rules Generation for CEP [slides]
  7. Complex event processing systems in practice: T-Rex [slides][ready to go pack]
  8. Data streaming systems in practice: Esper [slides][ready to go pack]
  9. RDF streaming systems in practice: C-SPARQL [slides][ready to go pack]
  10. On benchmarking Information Flow Processing Systems [slides]
    • The problem
    • Possible solutions
  11. Putting it all together [slides]
    • A practical scenario to test information flow processing systems
    • Experience report

Exam

Students are expected to put together what was taught in the course by

More details were provided during May 10, 2013 session (see the slides).

As May 15, 2013, the web form to register to the exam session, contains the following information:

Student 1 full name Student 2 full name We will use Esper and … We would like to present on

Daniele Dell’Aglio

Fabio Marfia SPARQL-Stream July 11, 2013 – 14.15 – 16.15
Visin Francesco Romanoni Andrea T-Rex July 11, 2013 – 14.15 – 16.15
Mohammad Ghafari Mohammad Mehdi Pourhashem kallehbasti SPARQL-Stream June 25, 2013 – 14.15 – 16.15
Sumit Datre Saurav Dahal T-Rex June 25, 2013 – 14.15 – 16.15
Hassan Saidinejad Fabio Veronese ETALIS July 11, 2013 – 14.15 – 16.15
Emanuele Panigati Gianluca Durelli Perla June 25, 2013 – 14.15 – 16.15
Julian Mauricio Angel Fernandez None C-SPARQL Engine June 25, 2013 – 14.15 – 16.15

All proposals are accepted.

Tools

Calendar

  • Apr 15, 2013 (14.15 – 17.15) – Sala Conferenze – ground floor – ed. 20: topics 1 [slides] and 2 [slides]
  • Apr 17, 2013 (14.15 – 17.15) – Room PT1 – ground floor – ed. 20: topic 3 [slides on Semantic Web][slides on stream reasoning]
  • Apr 22, 2013 (14.15 – 16.15) – Room PT1 – ground floor – ed. 20: topic 4 [slides]
  • Apr 23, 2013 (10.15 – 12.15) – Room PT1 – ground floor – ed. 20: topic 5 [slides] and 6 [slides]
  • Apr 24, 2013 (14.15 – 16.15) – Room PT1 – ground floor – ed. 20: topic 7 [slides] [TRex Client and Server]
  • May 6, 2013 (14.15 – 16.15) – Room PT1 – ground floor – ed. 20: topic 8 [slides][ready to go pack] and topic 9 [slides][ready to go pack]
  • May 10, 2013 ( 9.15 – 12:15) – Room PT1 – ground floor – ed. 20: topics 10 [slides] and 11 [slides]
  • June 25, 2013 (14.15 – 16:15) – Sala Seminari – ground floor – ed. 20: Student reporting 1st session
  • July 11, 2013 (14.15 – 16:15) – Meeting Room – 3rd floor – ed. 21: Student reporting 2nd session

References

[1] Brian Babcock, Shivnath Babu, Mayur Datar, Rajeev Motwani, and Jennifer
Widom. Models and issues in data stream systems. In PODS 2002: Proceedings of
the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database
systems, pages 1-16, New York, NY, USA, 2002. ACM.

[2] David C. Luckham. The Power of Events: An Introduction to Complex Event
Processing in Distributed Enterprise Systems
. Addison-Wesley Longman
Publishing Co., Inc., Boston, MA, USA, 2001.

[3] Emanuele Della Valle, Stefano Ceri, Frank van Harmelen, Dieter Fensel: It’s a Streaming World! Reasoning upon Rapidly Changing Information. IEEE Intelligent Systems 24(6): 83-89 (2009)

[4] Gianpaolo Cugola and Alessandro Margara. Processing flows of information:
From data stream to complex event processing
. ACM Computing Surveys,
44(3):15:1–15:62, June 2012.

[5] http://streamreasoning.org/