About
Leading all things AI @ Umbrage, part of Bain & Company.
If you're passionate…
Articles by Matthew
Contributions
-
What do you do if you want to leverage artificial intelligence and machine learning in public administration?
Implementing evalutions or "evals" is super important in your AI and ML applications. You need to set a standard for what success looks like and test against it. If you ever have to switch models, say GPT-4 to GPT-4 Turbo or even a 1.0 to 1.1, you have to re-evaluate every prompt against the new model, even for tiny model weight changes. Your prompt from 2 months ago might now work the same as today if the model you used changed in any way. Writing good evals lets you test your prompts and models are still working as intended and let you try out new models with peace of mind. Unfortunately, evals can be tough and expensive. But worth it for the stability.
-
What do you do if you want to leverage artificial intelligence and machine learning in public administration?
Choosing the right model or algorithm is very important. Data Scientists and Machine Learning Engineers alike learn intuition on which are the best for the right kind of problem. There's a lot of test and learn. You have to be ok with pivotting. In the case of LLMs, nothing beats the reasoning capabilities of GPT-4 right now, but its slow and expensive. It might be right to use GPT-4 for a plan-making or am ambiguity checking agent. Using Llama or Mixtral for those won't have nearly as good results. Claude 3 might lecture you about good vs evil instead of doing what you asked it to do. Try different models, learn intuition, and jam on.
-
What do you do if you want to leverage artificial intelligence and machine learning in public administration?
In my experience, most organizations have not yet solved their data problem. If you haven't organized and made available your data, you need to solve that first before you have any hope of using AI and ML to any useful degree. At NVIDIA GTC, Lowe's presented a session that talked about the importantance of data and giving their developers easy API access. Their devs are spending their times innovating instead of wrangling Salesforce queries. If you had a data problem before the AI revolution, you still have a data problem now. Solve that first. Walk before you run. It'll be worth it, trust.
Activity
-
Unstructured.io found that Claude 3.5 Sonnet achieves superior accuracy on form structures and noisy documents compared to OpenAI's GPT-4o when it…
Unstructured.io found that Claude 3.5 Sonnet achieves superior accuracy on form structures and noisy documents compared to OpenAI's GPT-4o when it…
Shared by Matthew Groff
-
I don't have a crystal ball, but I'll make a prediction anyway. 2025 will be the year of AI Agents and Knowledge Graphs. Some teams are already…
I don't have a crystal ball, but I'll make a prediction anyway. 2025 will be the year of AI Agents and Knowledge Graphs. Some teams are already…
Shared by Matthew Groff
-
I've got friends seeking a Technical Co-founder who can lead the MVP development and beyond of an AI assisted Sales accelerator. They're self-funded…
I've got friends seeking a Technical Co-founder who can lead the MVP development and beyond of an AI assisted Sales accelerator. They're self-funded…
Posted by Matthew Groff
Experience
Education
-
UC San Diego Extension
-
Graduated the Coding Bootcamp at UC San Diego Extension where I studied, worked, and became proficient working in the Full MERN Stack.
-
-
-
-
Licenses & Certifications
-
Supervised Machine Learning: Regression and Classification
DeepLearning.AI, Stanford University
Other similar profiles
Explore collaborative articles
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Explore MoreOthers named Matthew Groff in United States
-
Matthew Groff
-
Matthew Groff
-
Matthew Groff
-
Matthew Groff
Managing Director, Private Wealth Advisor at Morgan Stanley
68 others named Matthew Groff in United States are on LinkedIn
See others named Matthew Groff