About
Uli is a co-founder at Sonra,
Sonra offers products and services in data…
Services
Articles by Uli
Contributions
-
How do you track data lineage in your engineering work?
Horizontal Data Lineage traces data elements across the enterprise. In contrast, the vertical dimension of Data Lineage provides depth, connecting data to business processes, roles, rules, and definitions, offering context at every pipeline step. While horizontal lineage shows data flow, vertical lineage emphasizes why data moves, its business context, and who manages it. It operates on three levels: business (detailed processes), concept model (covering business relationships and rules), and physical data model (implementation of the concept model). Focusing on horizontal lineage misses this depth, reducing Data Lineage's full potential. The vertical dimension enriches the entire data journey's context.
-
How do you track data lineage in your engineering work?
Automating documentation of data pipelines. Perform impact analysis. What is the impact of a change to a table or SQL statement? Visual representation of data pipeline and SQL, e.g. https://sonra.io/flowhigh/from-code-to-clarity-visualizing-sql-code-for-documentation-and-debugging/ Planning data migration Automate the creation of column level access controls through column tagging. Identify sensitive data & PII within your data warehouse and operational systems. Regulatory compliance to trace data Root cause analysis for ETL failures and stepwise debugging. Data lineage provides a complete audit trail for data points of interest from the source to the final destination.
-
How do you automate data quality metrics for different platforms?
A prerequisite for defining data quality dimensions is to define business rules. Unless you have defined business concepts, business definitions and business rules you can't define data quality dimensions. Data quality issues are violations of business rules. Different types of business rules directly translate to data quality dimensions. Some examples Computational Rules: Rules that concern calculations. For example, "the sales tax for a product is 5% of its price." Constraint Rules: For example, "employees are not allowed to approve their own expense reports." Decision Rules: For example, "if a loan applicant's credit score is below 600, then their loan application is automatically denied." Data Integrity Rules and many more
Activity
-
🔮 Data Trend Prediction for 2025 🔮 Get ready, because this one’s a game-changer (or maybe not 🙂 ). In 2024 we’ve had it all: ✨ The Modern Data…
🔮 Data Trend Prediction for 2025 🔮 Get ready, because this one’s a game-changer (or maybe not 🙂 ). In 2024 we’ve had it all: ✨ The Modern Data…
Posted by Uli Bethke
-
Ever wondered how data flows through your Snowflake environment? Here’s how Snowflake helps you trace it: 🔍 Visual Lineage Say hi to the Snowsight…
Ever wondered how data flows through your Snowflake environment? Here’s how Snowflake helps you trace it: 🔍 Visual Lineage Say hi to the Snowsight…
Shared by Uli Bethke
-
The counterpoint to the Iceberg hype is very well articulated in this article. Funny side note, cuz I said the same thing on a podcast recently -…
The counterpoint to the Iceberg hype is very well articulated in this article. Funny side note, cuz I said the same thing on a podcast recently -…
Liked by Uli Bethke
Experience
Education
Publications
-
Discover the Oracle Data Integrator 11g Repository Data Model
You may be asking yourself why we have written a reference book for the ODI repository? Why not use the excellent ODI SDK to query that information? While the SDK is great at automating certain repetitive tasks it is not so good at retrieving information (in bulk) from the repository. Most ODI developers are familiar with using SQL. Not too many of us have a background in Java.
Some of the use cases for this book
- Extract information from the Operator log for reporting
-…You may be asking yourself why we have written a reference book for the ODI repository? Why not use the excellent ODI SDK to query that information? While the SDK is great at automating certain repetitive tasks it is not so good at retrieving information (in bulk) from the repository. Most ODI developers are familiar with using SQL. Not too many of us have a background in Java.
Some of the use cases for this book
- Extract information from the Operator log for reporting
- Impact analysis, e.g. find all interfaces a datastore is used in.
- Identify objects for deployment - Identify objects that have recently changed
- Error message extraction
- Automated code checklist
We have split the book into two sections. The first section covers the most important subject areas of the master repository, the second section covers the most important subject areas of the work repository. Each subject area comes with a submodel, a list of relevant tables and corresponding ODI screens, and most importantly one or more useful pieces of SQL code to query the subject area in question. We have also made the models of the subject areas available online on our website http://sonra.io/odi11rep -
Podcast: Data Warehousing and Oracle Data Integrator
OTN ArchBeat
The latest series of programs on the OTN ArchBeat Podcast presents a discussion of Data Warehousing and Oracle Data Integrator.
This time the guest producer credit goes to Oracle ACE Director Gürcan Orhan, who suggested the topic and selected the other panelists and we talked about usage of Oracle Data Integrator in Data Warehouse environment.Other authorsSee publication -
Real Time BI Podcast on ODI. Part II
-
In the second part of the series we discuss:
More discussion on ODI vs Informatica
More on migrating from OWB to ODI
Using ODI outside the data warehouse (BI Apps)
ODI in the cloud
ODI and Big Data
Honors & Awards
-
Snowflake Data Hero
Snowflake
-
Oracle ACE Associate
Oracle
The Oracle ACE program recognizes individuals in the community for sharing their insight and real-world experience. It has over 400 participants in 50+ countries worldwide.
Languages
-
English
Native or bilingual proficiency
-
German
Native or bilingual proficiency
-
French
Limited working proficiency
Organizations
-
DAMA Ireland
Vice President
- Present -
Hadoop User Group Ireland
Chair
- PresentThe Hadoop User Group Ireland is a forum to discuss Hadoop and Big Data related questions. Our purpose is to raise awareness of the benefits and use cases of Hadoop for your project. This also includes a focus on the technology aspects of smoothly running a scalable Hadoop cluster. We will run multiple events and workshops throughout the year. There will be something for everyone: typical Hadoop use cases, technical tips and tricks and best practices, case studies, data architecture, trends and…
The Hadoop User Group Ireland is a forum to discuss Hadoop and Big Data related questions. Our purpose is to raise awareness of the benefits and use cases of Hadoop for your project. This also includes a focus on the technology aspects of smoothly running a scalable Hadoop cluster. We will run multiple events and workshops throughout the year. There will be something for everyone: typical Hadoop use cases, technical tips and tricks and best practices, case studies, data architecture, trends and emerging technologies, ROI calculations etc. http://www.meetup.com/hadoop-user-group-ireland/
Recommendations received
2 people have recommended Uli
Join now to viewMore activity by Uli
-
📕𝗙𝗿𝗼𝗺 𝗭𝗲𝗿𝗼 𝘁𝗼 𝗛𝗲𝗿𝗼 𝗶𝗻 𝗦𝗻𝗼𝘄𝗳𝗹𝗮𝗸𝗲 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴📕 Excited to announce the release of Snowflake ❄️Data…
📕𝗙𝗿𝗼𝗺 𝗭𝗲𝗿𝗼 𝘁𝗼 𝗛𝗲𝗿𝗼 𝗶𝗻 𝗦𝗻𝗼𝘄𝗳𝗹𝗮𝗸𝗲 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴📕 Excited to announce the release of Snowflake ❄️Data…
Liked by Uli Bethke
-
Is it just me? Or has the war of the table formats turned into a war of the catalogs?
Is it just me? Or has the war of the table formats turned into a war of the catalogs?
Posted by Uli Bethke
-
Being part of a Snowflake Data Superhero community means committing to sharing knowledge and contributing to the data community. Much of my work has…
Being part of a Snowflake Data Superhero community means committing to sharing knowledge and contributing to the data community. Much of my work has…
Liked by Uli Bethke
-
We just partnered with one of our top 100 dream customers. They are a perfect example of an organization that would get a high ROI on data modeling.…
We just partnered with one of our top 100 dream customers. They are a perfect example of an organization that would get a high ROI on data modeling.…
Liked by Uli Bethke
Other similar profiles
Explore collaborative articles
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Explore MoreOthers named Uli Bethke
1 other named Uli Bethke is on LinkedIn
See others named Uli Bethke