Yazılım Mimarisi - Kappa Architecture - Stream Processing İçindir

Giriş

Açıklaması şöyle

In 2014 Jay Kreps started a discussion where he pointed out some discrepancies of Lambda architecture that further led the big data world to another alternate architecture that used less code resource and was capable of performing well in certain enterprise scenarios where using multi layered Lambda architecture seemed like extravagance.

Kappa Architecture cannot be taken as a substitute of Lambda architecture on the contrary it should be seen as an alternative to be used in those circumstances where active performance of batch layer is not necessary for meeting the standard quality of service. This architecture finds its applications in real-time processing of distinct events.

Açıklaması şöyle

In 2014, Martin Kleppman, author of the book Designing Data-Intensive Applications gave a seminal talk entitled Turning the database inside out. He outlined a new architectural pattern for processing data in real-time. The key insight is to externalize the write-ahead-log (WAL), which up to this point had been an internal (yet fundamental) component of every operational database. A streaming framework could then be used to process the log in near real-time, thereby providing an always-up-to-date equivalent to a materialized view.

...

In recent years, Kleppman’s inside-out database concept has gained popularity, and even acquired a name: Kappa architecture.

Bu mimari şeklen şöyle Hadoop tabanlı Batch Processing kısmı çıkarılıyor ve her şey Stream Processing ile hallediliyor.

Bu mimaride veri Hadoop gibi bir yerde devamlı saklanmadığı için hata yapılması durumunda geri dönüş daha zor.