Data Engineering Curriculum Archives | Page 3 of 3

This is the curriculum for IT professionals, data engineers, data analysts, and those supporting data science. The levels build up on another, each block represents a class of two days.

Modernising Your Data Warehouse and Analytic Ecosystem

2021-07-23T01:01:37+00:00May 20th, 2019|Tags: Management, Expert, Tech, Workshop, Stephen Brobst|

This full-day workshop examines the emergence of new trends in data warehouse implementation and the deployment of analytic ecosystems. We will discuss new platform technologies such as columnar databases, in-memory computing, and cloud-based infrastructure deployment. We will also examine the concept of a “logical” data warehouse – including and ecosystem of both commercial and open source technologies. Real-time analytics and in-database analytics will also be covered. The implications of these developments for deployment of analytic capabilities will be discussed with examples in future architecture and implementation. This workshop also presents best practices for deployment of next generation analytics using AI and machine learning.

Cost-Based Optimisation: Obtaining the Best Execution Plan for Complex Queries

2021-07-23T01:00:08+00:00May 20th, 2019|Tags: Expert, Tech, Workshop, Stephen Brobst|

Optimiser choices in determining the execution plan for complex queries is a dominant factor in the performance delivery for a data foundation environment. The goal of this workshop is to de-mystify the inner workings of cost-based optimisation for complex query workloads. We will discuss the differences between rule-based optimisation and cost-based optimisation with a focus on how a cost-based optimization enumerates and selects among possible execution plans for a complex query. The influences of parallelism and hardware configuration on plan selection will be discussed along with the importance of data demographics. Advanced statistics collection is discussed as the foundational input for decision-making within the cost-based optimiser. Performance characteristics and optimiser selection among different join and indexing opportunities will also be discussed with examples. The inner workings of the query re-write engine will be described along with the performance implications of various re-write strategies.

Optimising Your Big Data Ecosystem

2021-07-23T01:02:03+00:00May 18th, 2019|Tags: Management, Expert, Tech, Workshop, Stephen Brobst|

Big Data exploitation has the potential to revolutionise the analytic value proposition for organisations that are able to successfully harness these capabilities. However, the architectural components necessary for success in Big Data analytics are different than those used in traditional data warehousing. This workshop will provide a framework for Big Data exploitation along with recommendations for architectural deployment of Big Data solutions.

Agile Data Management Architecture

2021-07-23T00:57:04+00:00May 18th, 2019|Tags: Expert, Tech, Workshop, Stephen Brobst|

This full-day workshop examines the trends in analytic technologies, methodologies, and use cases. The implications of these developments for deployment of analytic capabilities will be discussed with examples in future architecture and implementation. This workshop also presents best practices for deployment of next generation analytics.

Capacity Planning for Enterprise Data Deployment

2021-07-23T00:59:25+00:00December 6th, 2018|Tags: Business, Management, Expert, Workshop|

This workshop describes a framework for capacity planning in an enterprise data environment. We will propose a model for defining service level agreements (SLAs) and then using these SLAs to drive the capacity planning and configuration for enterprise data solutions. Guidelines will be provided for capacity planning in a mixed workload environment involving both strategic and tactical decision support. Performance implications related to technology trends in multi-core CPU deployment, large memory deployment, and high density disk drives will be described. In addition, the capacity planning implications for different approaches for data acquisition will be considered.

Real-Time Analytics Development and Deployment

2021-07-23T01:02:51+00:00May 31st, 2019|Tags: Management, Business, Expert, Tech, Workshop, Stephen Brobst|

Real-time analytics is rapidly changing the landscape for deployment of decision support capability. The challenges of supporting extreme service levels in the areas of performance, availability, and data freshness demand new methods for data warehouse construction. Particular attention is paid to architectural topologies for successful implementation and the role of frameworks for Microservices deployment. In this workshop we will discuss evolution of data warehousing technology and new methods for meeting the associated service levels with each stage of evolution.

Previous 23

Data Engineering Curriculum

Training Courses, Workshops and Seminars

STRATEGIC PROGRAMS AND INITIATIVES

Services

DESIGN AND ADVISORY

DEVELOP INSIGHT

DELIVER AND OPTIMISE VALUE

CAPABILITIES