Justin Townsend, MBA

Join Kainos and Microsoft’s UK CDO for Azure Data & AI Matt Quinn for breakfast and engaging peer discussions with fellow data leaders.  This event will explore how data readiness can significantly impact AI enablement in your organisation.    If you're a data leader in financial services who would like to attend this intimate, interactive session, register today and join us at the event.    Register here: https://lnkd.in/gr2E7EwJ    #DataQuality #datareadiness 

10

🎤One of our panel sessions at Data Architecture London 2024 has gained another great speaker to join in with the conversation. Rajib Chakravorty, Senior Data Modeler, from Beazley will be discussing the topic of ‘Rethinking Data Architecture: Embracing Innovation and Shifting Mindsets’ with 3 other data experts on 11 September. 🔎The panel will discuss key insights such as: • Recognising the transformative power of treating data as a strategic asset, reshaping mindsets and sparking innovation. • Embracing Agile Development principles for iterative refinement in crafting resilient and adaptable data architectures. • Revolutionising data management with cutting-edge AI and ML technologies, unlocking unprecedented value through intelligent architectural design. • Safeguarding data integrity and privacy through AI-driven governance strategies, ensuring robust security measures are integrated from the ground up. 🎟️Join us in central London by registering for your ticket here: https://bit.ly/46CqUFc #CDAO #CDO #CAO #Data #Analytics #DataIntelligence #DataDriven #DataAndAnalytics #DataAnalytics #AnalyticsInsights #DataLed #DataTransformation #DataCulture #DataArchitecture #DataArchitectureUK

2

Seeing a lot of excitement for row-level security (which is amazing, no doubt!) but my team is more excited about column-level security. Being in banking, a lot of records are peppered with PII and the governance over who gets to see what (combination of) columns can get messy. With CLS, we can implement fact and one-big tables without having to resort to view gymnastics (i.e. using views to hash columns depending on the viewer) or maintaining multiple pipelines for the same table with different audiences. Just another win for Unity Catalog and Databricks.

4

A recommendation system in Power BI? In this blog, Konstantinos Ninas and Elena Pateraki demonstrate how users can provide feedback and dynamically interact with their data inputs, transforming Power BI into a robust application for real-time decision-making and engagement. Value added: 📊 Facilitation of decision making - easy access to insightful analysis 🛠 Easy-to-maintain - compatible with multiple environments ⏳ Enhanced speed - updates in 5-7 seconds, almost as fast as a dedicated application 🔎 Versatile reporting - functions as report and application 👕 Keep it simple: Straightforward solution on common technology You can find the full article here: https://lnkd.in/dSPvrGEc #application #PowerBI #realtime #datadriven #doneai

32

It's found a majority of British businesses recognize the critical role effective data governance plays. A further 86% agreed that "data governance will become more important over the next five years." Below are the findings of a survey on data governance. #Data #DataGovernance #Technology #DataLiteracy

8

Best data news? It's right here 🎺 https://lnkd.in/ecYCuxYD Check it out: Medium 🧠 🧠 The BigQuery Qualify clause @matteoBennio 🧠 How Notion handles 200bn data entities Vu Trinh 🧠 A scalable ingestion framework in MS Fabric Piethein Strengholt 🧠 Migrating and testing out pyairbyte Felix Gutierrez 🧠 Snowflake vs Databricks; a useful comparison for 2024 Hugo Lu 🧠 People do not like this latest article “The rise of the notebook engineer” (sorry Daniel Beach!) **Editors Pick** 🧠 How Pinterest do Analytics Kapil Bajaj LinkedIn🕴 🕴 BigQuery release continuous Queries and real-time rELT (also see Richard Shenghua (升华) He's excellent post on this recently) 🕴 Difference between Junior and Senior engineers 🕴 Trio of Leaders leave Open AI #dataengineering #roundup #dataroundup #bigquery #streaming

14

3 Comments

We attended Big Data LDN, the UK’s top data event, and uncovered game-changing insights for your data strategy 🤖🧠 From AI-driven personalisation to the future of data governance, it’s all here.   Curious about which brands are leading the AI race? 🏃‍♂️💨 Or why building your data foundation now is critical for future growth? We’ve got the answers in our blog.   👉 Read the full blog for expert insights, real-world examples, and what your business needs to stay ahead https://lnkd.in/esrJ7sDG   #AI #BigData #DataStrategy #Team #GenerativeAI #BigDataLDN

11

1 Comment

🎤Our next speaker for Data Architecture London 2024 will be doing their own presentation asking the audience, ‘How can data architecture improve efficiency, reduce cost and complexity’, lead by Jeremy Posner, Lead Data Architect, at Fidelity International, on 11th of September! 💡Get your thinking caps on and sign up here: https://bit.ly/4ch5Kxx #CDAO #CDO #CAO #Data #Analytics #DataIntelligence #DataDriven #DataAndAnalytics #DataAnalytics #AnalyticsInsights #DataLed #DataTransformation #DataCulture #DataArchitecture #DataArchitectureUK

3

#Knowledge is at the heart of your business—knowing better means doing better. That's the power of integrating #ReasoningAI (and not just #GenAI) & #KnowledgeGraph into your data and content strategy. And it's not just us saying it; Gartner's experts agree! 😉 #DataStrategy #KnowledgeGraph #KnowledgeOperatingSystem #CognitiveAssetManagement

6

✨Data Governance for Leaders✨ Introducing our "Data Governance for Leaders" public course - a game-changing course developed by Daragh O Brien CEO and founder of Castlebridge. Castlebridge is at the forefront of shaping the future of data governance frameworks. This immersive course equips business leaders to: 💡Understand what Data Governance is, its significance in business operations, how it affects the relationship between people and data 💡Understand the role of Data Steward in ensuring data integrity, quality assurance processes and compliance within an organisation 💡Be able to explain Data Governance as a strategic management framework, demonstrating its alignment with business objectives and regulatory requirements  💡Be able to explain the inputs, activities, and outputs of a Data Governance function to enhance organizational decision-making and risk management capabilities and support the sustainable implementation of digital transformation or data innovation. 🚀Our cutting-edge curriculum combines fundamental concepts with practical applications through real-world case studies and interactive activities. Participants will gain implementation-ready skills tuned to emerging governance standards. 🔑Book your spot today: https://lnkd.in/eWYPUGrN 25% discount until 30 July using discount code SummerSale or for groups of 2 or more contact us on [email protected] to explore further discounts or bringing "Data Governance for Leaders" to your organization! #DataGovernance #DataStrategy #DigitalLeadership #FutureOfData

2

🔊Members Only Webinar - Unveiling Insights: Key Findings from the Data Governance Survey Join us for an exclusive webinar as we share the first insights from a Data Governance survey run by Baringa Partners and Nicola Askham, The Data Governance Coach. Our survey explored the practices and challenges in data governance globally across industries. We'll share highlights from the survey, including findings which surprised us. Whether you're a Data Governance Practitioner or a Data Leader, this webinar will deliver invaluable insights to enhance your organisation's data governance journey. Join Nicola, along with Danielle Calabrese and Martha Casey from Baringa Partners as they share the initial results of the survey. A registration link will be issued to DAMA UK Members in due course so keep an eye on your emails. #data #datawebinar #datamanagement #datagovernance #damauk

27

The Future of AI and Data Management: Key Takeaways from Databricks 💡 Chris Marshall, Lead Architect at Optima Partners, recently attended the Databricks Data+AI World Tour in London, where AI and data management took centre stage. He shared key insights on: ➡ How generative AI is revolutionising complex processes and accelerating innovation. ➡ Tools like AI/BI Genie are simplifying access to valuable insights. ➡ Why open-source AI is affordable, powerful, and levelling the playing field for businesses. ➡ The growing focus on data governance and compliance in the age of AI. Read his full insights here: https://lnkd.in/eDUNcZ84 #Databricks2024 #AI #GenerativeAI #MachineLearning #OptimaPartners #Innovation #DataGovernance

31

3 Comments

We are ready with another online Module for the Data Engineering workshop series 🗓 20 July, 3pm SGT to 5pm SGT Topics covered: ✅ Concept of Data Warehouse, ✅ Dimensional modelling ✅ Steps for designing a Data Warehouse, ✅ Available online workshops for Data Warehousing. Data Warehouses are an old concept but they are here to stay - it is necessary for every Data Engineer to know the principles of their design so they can succesfully: maintain existing infrastructure, migrate and refactor legacy systems to the cloud, design, develop and deploy new warehouses on new cloud platforms. The module is for beginners; however, it is advisable that attendees have a basic understanding of SQL and working with data. Register here: https://lnkd.in/gduqFP7C #shelovesdata #dataengineering #datawarehouse #data

13

1 Comment

Databricks offers granular access control mechanisms that empower organizations to enforce data governance and privacy policies effectively. Through column-level and row-level security, companies can safeguard sensitive data while maintaining flexibility in data access. The use of dynamic views enables Access Control Lists (ACLs) to tailor visibility based on user roles and privileges. This ensures that authorized users have full access, while restricted users receive filtered or redacted data, aligned with predefined governance rules. In scenarios where personal identifiers—such as email addresses, first names, and last names—are present, restricting field-level access becomes crucial to comply with data privacy regulations like GDPR. With dynamic views, organizations can dynamically adjust access without duplicating data or creating multiple datasets, making compliance scalable and efficient. This approach not only simplifies compliance with regulations but also ensures seamless data governance across departments, providing the right people with the right level of access. By leveraging Databricks' capabilities, organizations can strengthen data security, reduce risks, and optimize data-sharing practices within an auditable framework. #DataGovernance #Databricks #DataSecurity #AccessControl #DynamicViews #PrivacyCompliance #GDPR #AI #CloudSecurity

2

🚀 Exciting #Partnership Announcement: Eden Smith and #XcelerateIQ Join Forces! In an era where companies are heavily investing in data infrastructure and AI, many face challenges such as underutilisation, poor adoption, and a critical skills gap. This leads to missed opportunities and unrealised return on investment. To address these pressing needs, Eden Smith is thrilled to announce our strategic partnership with XcelerateIQ. What This Partnership Brings This collaboration is more than just aligning resources; it’s about reshaping how organisations approach data and AI transformations. By merging Eden Smith’s extensive expertise in talent development with XcelerateIQ’s innovative focus on data culture and mindset, we’re setting a new standard for sustainable Data and AI enablement. Our Clients Can Expect to: Build robust talent strategies that attract and retain data and AI experts. Embed data-first thinking and foster a culture of continuous learning. Develop adaptive habits and behaviours that thrive amid technological evolution. Why XcelerateIQ? XcelerateIQ, led by the brilliant Rosanne Werner, is known for integrating cognitive psychology, organisational behaviour, and change management to elevate Data and AI initiatives. Rosanne’s remarkable leadership in data transformation at Coca-Cola and her innovative, science-based approach make XcelerateIQ a perfect match for #EdenSmith. A #PeopleFirst Approach to Transformation Our combined goal? To ensure that technology and human capability grow hand in hand. Eden Smith and XcelerateIQ are committed to empowering organisations with the right skills and culture to navigate and lead in the fast-paced digital world. 🔗 Join us as we redefine Data and AI transformation. Here's to driving forward-thinking and impactful change! https://lnkd.in/eESbXHp7 With Jez Clark Matt Smith Rosanne Werner Christa Swain Nicholas Deveney #DataTransformation #DigitalTransformation #DataCulture

12

9 Comments

Good article on practical tips to improve the #RAG pipeline - across indexing, retrieval and generation. • Indexing - level up with simple, semantic or #LLM based chunking • Retrieval - implement hybrid search, combining vector and keyword searches • Query Rewriting - optimize queries for better retrieval • Metadata - boost retrieval accuracy with rich contextual data • Autocut - filter out irrelevant information from retrieved content • Reranking - prioritize the most relevant content, enhancing retrieval precision https://lnkd.in/eJMvu3XJ

7