Practical Guidelines for Designing Modern Data Architectures

Practical Guidelines for Designing Modern Data Architectures


Practical tips, experiences, guidelines, do's and don'ts, resulting in an action plan for developing your complete, correct and future-proof data architecture

23-24 March 2022 (9-17h CEST)
Location: Live Online Event (@YOUR DIGITAL WORKPLACE)
Presented in English by Rick van der Lans
Price: 1250 EUR (excl. 21% VAT)
Register Now »

 Learning Objectives

Why do we Organise this Masterclass with Practical Guidelines for Designing Modern Data Architectures" ?

Digital transformation, the data-driven organization, and the ‘data economy' are popular topics in boardrooms today, because organisations understand the need to do more with data. They want to make use of the strengths and benefits of data science, self-service BI, embedded BI, edge analytics, and customer-driven BI. The consequence is that data needs to be deployed more widely, more efficiently, and more effectively. Unfortunately, current IT systems, such as the data warehouse and transactional systems, can no longer cope with the ever-increasing workload. They have already been overstretched. For many organisations it's time for a new and future-proof data architecture.

But designing new data architectures is not something you do every day. This two-day masterclass answers many common questions raised when designing new data architectures. Practical guidelines, tips, design criteria, tips, design principles, use cases, and real life examples are extensively discussed. Concepts and technologies, such as data lakes, data hubs, data fabrics, big data, cloud, data virtualization, Hadoop, NoSQL, and data warehouse automation, are explained. This seminar is based on practical experiences with designing and implementing modern data architectures for numerous organizations.

Rick explains what you can expect from this masterclass:

This masterclass is a LiveOnline event. This meas that there will be an expert speaker in a virtual meeting room along with you and other highly interested participants. We will make your learning experience as immersive and interactive as we have done in the past 25+ years, but now in a live, online environment. Besides answering your appetite for knowledge and your questions, we will stimulate the interactivity between the speaker and the participats, and between participants.

What will you learn in this masterclass ?

This masterclass has various modules:

  1. Introduction: what is a data architecture?
  2. Overview of new technologies for data storage, data processing and data analytics
  3. Design aspects of data architectures
  4. Innovations in data architecture
  5. Step-by-step guide and action plan for developing a complete, correct and future-proof data-architecture

Who should attend this masterclass ?

This two-day seminar is aimed at everyone who is working with data in your organisation, from strategists to implementation specialists, and feels that a new, more modern, future-proof data architecture is needed.

Your role can range from Chief Data Officers (CDO) and technology planner to ICT and enterprise architect, and from data analyst, data warehouse designer, data architect, solution architect, to data engineer, data scientist and data consultant.

Learning Objectives: This masterclass with Rick van der Lans answers these and many other questions:

  • What is the roadmap to come up with a new and perfect data architecture? From requirements analysis via proof of concept (PoC) to a future-proof data architecture
  • Why is a holistic approach in studying technology, organisation and architecture important?
  • What are good practical examples of new data architectures?
  • How can the use of technologie in a new data architecture be optimised?
  • How do you set up a new data architecture?
  • What are the components of a data architecture?
  • What are the use cases, advantages and disadvantages of new technologies and how do they influence your data architecture ?
  • What is the value of well-known reference architectures, like the Lambda architecture, the logical datawarehouse architecture, the data lake, the data hub, and the data mesh?
  • Which criteria should your data architectuur meet?

 Full Programme

Presented by Rick van der Lans

This masterclass is a LiveOnline event. This meas that there will be an expert speaker in a virtual meeting room along with you and other highly interested participants. We will make your learning experience as immersive and interactive as we have done in the past 25+ years, but now in a live, online environment. Besides answering your appetite for knowledge and your questions, we will stimulate the interactivity between the speaker and the participats, and between participants.

8.45h - 9.00h
We welcome the participants in our digital lobby (Zoom waiting room)
9.00h
Introduction to this masterclass

1. Introduction - what is a Data Architecture ?

  • Why a new data architecture?
  • Examples of real life data architectures
  • What are the key elements of a data architecture?
  • What are the differences between a data architecture and a solutions architecture?
  • Benefits, drawbacks, and shortcomings of well-known reference architectures, such as the classic data warehouse architecture, the data lake, data hub, data meash, and transactional systems
  • From vision to implementation plan

2. Overview of New Technologies for Data Storage, Data Processing, and Data Analytics

  • Benefits, drawbacks, features, and use cases of each technology
  • Data storage: analytical SQL, NoSQL, Hadoop, cubes
  • Data integration: ETL, data virtualization, data replication, data warehouse automation, enterprise service bus, API gateway
  • Data streaming: messaging, Kafka, streaming SQL
  • Data documentation: data glossary, data catalog, metadata management
  • Reporting tools: self-service BI, dashboards, embedded BI
  • Data science tools: programming languages, such as R and Python, machine learning automation tools, data science workbenches
  • Data security: anonymization, authorization
12.45h - 13.45h
Break for (Bring your own) Lunch

3. Design Aspects for Data Architectures

  • First the technology or first the data architecture?
  • The importance of reusable transformation specifications for e.g. integration, filtering, correcting, and aggregation of data
  • Influence of specialized technology on data architectures
  • Why migration to the cloud: unburdening, high performance, scalability, available software?
  • Are all software products suitable for the cloud?
  • Design principles for dealing with data history and data cleansing
  • Modernization of a classic data warehouse architecture
  • Generating a data warehouse architecture with data warehouse automation tools
  • New requirements for transactional systems, such as storing historic data and continuous logging
  • The influence of GDPR: deleting customer data
  • Responsibility of data quality
17.00h
End of Day 1, Questions and Answers
Day 2: 8.45h - 9.00h
We welcome our participants in our digitale lobby / waiting room

4. Innovative New Data Architectures

  • The logical data warehouse architecture as an agile alternative
  • Design rules, do’s and don’ts for a logical data warehouse architecture
  • From a single-purpose to a multi-purpose data lake
  • Processing and sharing operational data with a data hub
  • Developing a data mesh to avoid a centralized, monolithic database
  • Requirements for implementing data science models, such as transparency, immutability, and version control
  • The changing role of the data lake: from data delivery system for data scientists to a platform for storing all the enterprise and external data
  • A data streaming architecture; when every microsecond counts
  • Technical challenges: performance, inconsistent data streams, storing massive amounts of messages for analytics afterwards
  • Operationalization of data science models
  • Merging data architectures to one unified data delivery platform
  • Differences between data hub and data warehouse
  • The data marketplace: from tailor-made to ready-made
12.45h - 13.45h
(Bring your own) Lunch Break

5. Action Plan for Developing a Complete and Correct Data Architecture

  • What is your business motivation for a new data architecture: ICT cost reduction, competitive improvement, new business model, new laws and regulations, improving reaction speed to business demands, or a more efficient exploitation of available data?
  • The importance of a business strategy and data strategy and the relationship with the data architecture
  • Maturity level of the ICT organization
  • Description of the current data architecture; data flow, data storage, quantities, and technologies in use
  • Stock-taking of current bottlenecks; business and ICT, performance, functionality, costs, ICT organization and the immediate environment
  • Constraining rules, such as laws and regulations, budget restrictions, software limitations, and legacy systems.
  • Requirements and needs of the new data architecture; financial, available expertise, software, quantities, uptime, speed of data delivery, and level of unburdening.
  • Architecture and design principles
  • Current and future forms of data usage: standard reports, self-service BI, data science, customer-driven, mobile apps
  • Forms of data usage; batch, manual internally, manual externally, and sensors
  • Data types in use, including structured, unstructured, audio, video, text, and Geo/GIS
  • Setting up the data architecture project; which choices must be made, which steps to take, is a PoC or Pilot required, what are key questions in a RfI, and convincing the organization

6. Closing Remarks

17.00h
End of this Two-day Masterclass, Opportunity to continue the conversation and Q&A until 17.30h

 Speakers


Rick van der Lans (R20/Consultancy BV)
R20/Consultancy BV

Rick van der Lans is a highly-respected independent analyst, consultant, author, and internationally acclaimed lecturer specializing in data architectures, data warehousing, business intelligence, big data, and database technology. In 2018 he was selected the sixth most influential BI analyst worldwide by onalytica.com.

He has presented countless seminars, webinars, and keynotes at industry-leading conferences. For many years, he has served as the chairman of annual Data Warehousing and Business Intelligence Summit in The Netherlands.

Rick helps clients worldwide to design their data warehouse, big data, and business intelligence architectures and solutions and assists them with selecting the right products. He has been influential in introducing the new logical data warehouse architecture worldwide which helps organisations to develop more agile business intelligence systems.

Over the years, Rick has written hundreds of articles and blogs for newspapers and websites and has authored many educational and popular white papers for a long list of vendors. He was the author of the first available book on SQL, entitled including Introduction to SQL, which has been translated into several languages with more than 100,000 copies sold. Recently published books are Data Virtualization for Business Intelligence Systems and Data Virtualization: Selected Writings.

He presents seminars, keynotes, and in-house sessions on data architectures, big data and analytics, data virtualization, the logical data warehouse, data warehousing and business intelligence.

Check out these related open workshops:

Check out our related in-house workshops:

Questions about this ? Interested but you can't attend ? Send us an email !

-->