10 Predictions for Big Data in 2020
Apache Arrow becomes fastest project to reach 10M downloads/month.
“Apache Arrow (co-created by Dremio) has firmly established the industry-standard for columnar, in-memory data representation and sharing, powering dozens of open source & commercial technologies and making data science 100 to 1000X faster. Arrow has already achieved over 6M monthly downloads in the three years since release, with downloads continuing to grow exponentially. As a result, we predict Arrow will reach 10M downloads/month in 2020, faster than any other Apache project. And with the release of Apache Arrow Flight (also co-created by Dremio) this past October, the performance benefits of Arrow are being extended to the Remote Procedure Call (RPC) layer further increasing data interoperability. While Arrow Flight is just getting started, we predict that by 2025 it will replace decades-old ODBC/JDBC as the de facto way in which all modern data systems communicate.” – Dremio‘s CEO Tomer Shiran
Big data democratization will make everyone data analysts.
“Big data has been a buzzword for so long, it has lost value. But, in 2020 and beyond, we’ll see it begin to provide real, tangible results. One reason for this is that data warehousing tools have improved and are no longer inhibitors to accessing enterprise insights in real time. Going forward, employees and stakeholders – from IT to the Board of Directors – will be able to more easily tap into the data well and become analysts themselves. And, with the democratization of data, the focus will shift from how to access data to: 1) asking the right questions of data, and 2) identifying who within your company is best positioned to analyze and glean answers from that data.”- Chris Patterson, senior director of product management, Navisite
Kubernetes for everything:
“Kubernetes recently surpassed Docker as the most talked about container technology. In the future, every data technology will run on Kubernetes. We may not quite get there in 2020, but Kubernetes will continue to see rising adoption as more major vendors base their flagship platforms on it. There are still some kinks to be ironed out, such as issues with persistent storage, but those are currently being addressed with initiatives like BlueK8s. The entire big data community is behind Kubernetes, and its continued domination is assured.”- Unravel Data CEO Kunal Agarwal
Small data gets big:
“Going forward, we’ll no longer require massive big data sets to train AI algorithms. In the past, data scientists have always needed large amounts of data to perform accurate inferences with AI models. Advances in AI are allowing us to achieve similar results with far less data.” –Zinier CEO Arka Dhar
DataOps Will Reign in the 2020s:
“With an increasing number of systems, use cases and the sheer volume of data, data pipelines will be top of mind for organizations in 2020 and beyond. Businesses will continue to pursue more advanced data, analytics, and AI initiatives across their organization, which will necessitate DataOps sophistication to keep pace with the accelerating data development lifecycle. DataOps is by no means a new term or methodology, but increasingly, businesses will begin adopting DataOps practices to be able to scale and deliver on their investments in data, analytics and machine learning applications.“ – Sean Knapp, founder and CEO, Ascend
BI tools go far and wide:
“The march toward being a data-driven enterprise has become a self-fulfilling prophecy, and in 2020 it will mean more than “consume this report.” We now have a generation of young business professionals who are used to asking questions and getting immediate answers. This dynamic has resulted in increased pressure on IT to make it easier and faster to get answers to questions, and that pressure is only going to multiply in 2020.” -Peter Guagenti, CMO, MemSQL
Read original article: here
Amsterdam is one of Europe’s leading tech-hubs. Companies are enhancing their international orientation in order to draw in talented internationals who can help them realise their projects. Esti, IT recruitment Amsterdam, attracts and retains international IT talent by guiding companies to develop a culture in which international professionals thrive. The perfect match is not only about meeting 100% of the requirements but most of all about change, progress and new experiences. Esti focusses on the personal motivation and ambition of each professional.