Data, Decisions & Automation Unleashed, an IBM TechXchange Workshop
Yesterday, the IBM Tech Exchange workshop was held, bringing together leading experts in the fields of Artificial Intelligence, Business Intelligence, Data Science & Big Data. I was honored to have the opportunity to present the latest developments in real-time integration, as well as ways of solving concrete challenges I have encountered during more than 25 […]
Celebrating the first year of new Big Data and AI platform
Many people believe that a successful Big Data & AI platform requires an army of developers, DevOps engineers, system administrators, database administrators, many specialist for real-time integration with other systems, data analysts, data scientists, and many others, as well as a large team to maintain and support such systems — which includes monitoring, patching, upgrades, […]
Building large-scale Business Intelligence & AI analytics using open-source tools on real-time data
The creation of business intelligence analytics and the development and deployment of AI/ML very often, due to their very complex architecture, end up utilizing expensive commercial tools. For the same reason, such solutions are very difficult to maintain, troubleshoot, tune and scale. Furthermore, to be successful, traditional methods require knowledge of numerous new technologies and […]
Real-time Deep Learning at Bug Future Show conference
On Thursday, February 2, 2023, the tenth Bug Future Show will be held, which for the first time will introduce a third parallel track called “.debug Future Show” intended primarily for IT people, where, among other things, you can find my lecture titled called “Real-time Deep Learning” starting at 11:15. This is a short […]
AI2FUTURE2022 conference
From October 13th – 14th I’ll participate for the first time on #AI2FUTURE2022 , the most interesting AI conference in this part of Europe. Besides many interesting lectures, new startups and practical examples, for me as a CroAI society member this is a chance to discuss hot topics, new tech & trends in the field […]
How to get 100% cache hit rate by using Change Data Capture & Redis
In this blog I’ll explain how to get 100% cache hit rate by using CDC (Change Data Capture) technology and Redis cache. There are multiple benefits of having caching layer in front of back-end database system. By fetching data from the cache instead of back-end we are actually free up valuable database resources for […]
Apache Ignite – distributed In-memory SQL database
Apache Ignite is one of the very few In-memory SQL compliant distributed databases/data grid among open-source projects. It’s often called “Redis done right” or “Redis on steroid”, because Redis looks primitive and limited when compared with Apache Ignite. Ignite offers great flexibility and lot of features that can easily fit to many use cases. Instead […]
YugabyteDb – distributed SQL database for a new age
Recently I’ve got a chance to try YugabyteDb, one of the new age databases which try to tackle with new requirements such as scalability, resilience, high availability, Cloud/Hybrid readiness and new architecture styles based on microservices. Although Yugabyte is relatively young company, it attracts a lot of attention, not only from architects/developers/admins, but also from […]
How to create a real time machine learning pipeline with StreamSets Transformer
Artificial Intelligence (AI) with its subset ML (Machine learning) is probably one of the hottest topics in IT industry today. Many companies are struggling to implement AI algorithms into data pipelines to make smarter decisions with more or less success. First of all, the AI is a wide topics which requires knowledge of math, statistics, […]
Complex near real-time transformations in data pipelines
For many years, ETL daily batch job was the dominant way to perform data transformations before loading in Data Warehouse. These days requirements are quite different starting with the most important one which is to ensure that new data has to be available for AI/ML and analysis near real time. Moreover, classical DWH databases are […]