Data Engineering and the Cloud: Simplicity Empowers Everyone
Over the past two decades, we have watched as data has become increasingly strategic to nearly every organization. During that time we have lived through the evolution from Big Data (new challenges) to Data Science (new projects) to Data Engineering (new practices). The next step is now in sight: an open and inclusive Data Engineering Cloud that brings together a diversity of stakeholders to transform business, science and government.
Getting this right requires a “big tent” approach that connects data experts and domain experts, hand-coders and no-coders, engineering discipline and analytic agility. In this context, new technologies and tools for data engineering and data science are key to bringing these constituencies together, and empowering all the players—whether they are data experts or subject matter experts—to work effectively and work together. In this talk I will show what an inclusive Data Engineering Cloud looks like, and how a decade of innovation in computer science—from AI to interactive visualization to program synthesis to data operations—can enable the transformational promise of data.