Lessons learned searching through 24+ billion records with Elasticsearch

Zaal 3

16:50 - 17:40

Big data & machine learning

One of the largest banks in the Netherlands wants to index all banking transactions for all the customers with Elasticsearch and in the cloud. We will take you on the journey that we took to realise this, and show you what we learned on the way. As it turned out not to be as easy as putting the data in and leaving it up to Elastic to work it out for you. Some topics that we will touch upon: Use Elastic as a source of truth or not? Data modelling and schema evolution Keeping searches performant Multi data-centers Ops After this talk, you should get a better idea what it takes to setup and maintain a large Elasticsearch cluster and will be familiar with the pitfalls that most people run into when they start with Elasticsearch.