40M tables in MySQL 8.0 with ZFS

Alexander Rubin

 | September 3, 2018 | 

Posted In: Benchmarks, Big Data, MySQL, MySQL 8.0, ZFS
In my previous blog post about millions of table in MySQL 8, I was able to create one million tables and test the performance of it. My next challenge is to create 40 million tables in MySQL 8 using shared tablespaces (one tablespace per schema). In this blog post I’m showing how to do it and what challenges we can expect.
Background
Once again – why do we need so many tables in MySQL, what is the use case? The main reason is: customer isolation. With the new focus on security and privacy (take GDPR for example) it is much easier and more beneficial to create a separate schema (or “database” in MySQL terms) for each customer. That creates a new set of challenges that we will need to solve. Here is the summary:
Too many files. For each table


Original URL: http://feedproxy.google.com/~r/feedsapi/BwPx/~3/H159ydqd1kU/

Original article

Comments are closed.

Proudly powered by WordPress | Theme: Baskerville 2 by Anders Noren.

Up ↑

%d bloggers like this: