Brian Overstreet

I am excited to share the latest blog, co-authored by myself, Junhwi Kim and Vyas Sekar, detailing how we managed to successfully localized and improved LLM by combining Fine-Tuning and RAG. https://lnkd.in/gKDkgGPq

70

3 Comments

Large Language Models (#LLMs) are evolving rapidly, and the demand for running them at scale is skyrocketing. #Ollama is stepping up to meet this need with its official container image on Docker Hub, excelling in local #deployments. However, there’s a catch for containerized environments: downloading #models requires the ollama serve command to be running within the #container. This extra step complicates automated deployments via #CI #CD #pipelines, making seamless model access challenging. To take your #model to production, it needs to be #container-ready—a feature Ollama has yet to fully support. The gap in #AIOps for smooth deployments gets blurred with the inference services available as an easy way to take it to production. Goal is to overcome obstacles and deliver solutions 😉 so here is to get you started on having your (O)#llama #production ready in a private #deployment from your #local to #cloud all in #oneshot . Enjoy Medium: https://lnkd.in/g9jqBQ8d dev.to: https://lnkd.in/gi_gGwam #AI #LLM #Ollama #llama3 #phi3 #mistral #S6overlay #AIOps #CI #CD #oneshot #container #docker #podmanEnjoy

11

🍜Anybody up for some ramen? I am excited to share that I am back in the garage, building again (it’s actually a house in the Berkeley Hills). We are taking the wraps off of Supercog AI, a new startup focused on solving Application Integration using LLM powered agents. My co-founder in this new venture is a great friend of mine (and a former co-founder partner), Alex Osborne. Alex and I have worked around the application integration space for a long time, and we are unrealistically excited about applying the GenAI stack to this problem. Not many people relish the task to get some bits to move from system A to system B. But it’s a critical job to be done, and that’s led to a lot of brittle scripts, a myriad of inflexible “no code” tools, and a lot of hand crafted SQL. But the power of the Large Language Model, trained on a huge corpus of information, offers a remarkable tool to solve this problem. The LLM you use today already knows the APIs of hundreds of popular systems. It knows the SQL dialects of every major database. It understands the semantics and data schemas of many popular SaaS systems. It understands much of the specific domain in which your business operates. I like to call the AI revolution “the last platform shift”. That may turn out to be hyperbole, but I definitely believe we are in the very early stages of seeing what this new stack can enable. I know we are hardly the first folks to claim that “amazing stuff is coming!”. But this is why Alex and I have decided to focus on a real and hard problem. If we can prove that LLMs can power a new way to solve this problem, it will be the first successful *new* approach in 15 years.. We will have much more to share about this new platform soon. In the meantime, if you’re interested in getting a peek - or even better if you have application or data integration tasks that you would like some help with - please reach out because we want to help. #genai #startups #backinthegarage

163

37 Comments

Since launching last Fall, its been incredible to see all the many workflows and integrations that companies are building with Lucid's Developer Platform. We've seen companies build automated processes and deeply linked templates that help with Sales, Marketing, Operations, and Engineering teams get the most out of Lucid. Come learn how to get started building from two of our engineers on the API teams who help engineers build these integrations every day.

20

1 Comment

tldr: I'm hiring! As many of you know, I recently joined Lattice as their SVP of Engineering and I'm excited to announce that I'm hiring for all Engineering levels and more broadly, Lattice has open roles across EPD. If you're wondering, why Lattice? The last few years have seen a step change in how we think about the meaning of work and the employer <> employee relationship - add on the fuel of AI taking our jobs and you could be forgiven for thinking the future of work looks bleak for employees. It doesn't need to be that way - here at Lattice we're building the next generation of talent tools to give employers insights and employees purpose because people matter at work. Among other things, we're using generative AI to securely analyze enormous volumes of data to unlock career insights faster and investing in building equitable feedback, compensation and employer analytics tools - not just for one company but for all companies. If you're interested in making a difference to the future of work then let's chat - all roles are remote eligible and based in the US. We have physical offices in San Francisco and NYC if you prefer the in-office environment.

324

48 Comments

sharpening writing skill is one of killer skill!

2

Waymo is probably both more expensive and longer waits on average than Uber or Lyft today, but they are close enough, and rapidly getting better. These markets will flip to fully autonomous when the tech is ready.

1

If you have built and operated an application or service that relies on an operational database in production, you will immediately understand the insane amount of value that these features deliver.

10

Recently took on the challenge of building an app from scratch using a new tech stack by leaning into ChatGPT. The outcome was much better than I expected and I only had to deep dive into the code in a few tricky situations. https://www.jimoto.life/ (It originally started out as an app to help my in-laws find a good neighborhood to move to, but I got carried away with a few other fun features... 😅 code, layout, even the background image and color schemes are AI generated/suggested.) ChatGPT is a must have for anyone in tech for sure . #ChatGPT #AI #AppDevelopment

5

1 Comment

/*********Mentorship**************/ I was watching today Andy Jassy's video (https://lnkd.in/gRV2mGPr) on career advice. He shared one of the very important thing on Mentor's. Mentor's overall objective is too help you grow. They let you do things which you even think you can not do and then give support if needed. They give honest feedback on areas of growth.

1

This is throwing money to garbage . They can’t make money from it. The only model that works is mine and will give it to European car makers. The first lucky one . So mark this date today may 5th 2025. It is very easy you look you don’t see the money in this model . It just because there is no money 😉🤔😁. To give you a hint so that you don’t say this guy is BS . Ask yourself the question why do we need self driving cars in the first place. Who told you that people have a problem with driving their cars . Most people enjoy driving their cars . And one idiot came up with this idea that he thinks it is cool and told them stop driving your cars because you need this Autonomous driving feature that you will pay for it to stop driving your car . Similar to taking the bus😁. Genius American mind 🇺🇸👌 Anyhow, if you need help to monetize this another stupid idea . You know what to do?

1

1 Comment

This is a nuanced subject and I really don't know if there's an "ethical" way to use AI for defense. On the other hand, if the US government doesn't do it, other governments will. What is really the definition of "ethical AI" in defense? Is it compliance with international laws? Let's be realistic, at the time of war, these rules are thrown out of the window and anything can be justified especially if politicians don't understand the tech. In any case, I doubt any company making profit from these fat federal contracts at this early stage of AI maturity is acting in good faith. #responsibleAI #ethicalAI

8

2 Comments

Dear friends, and colleagues, we are starting a new STEM program for youth girls, and wondering if you would help support the its goals, by donating a bit through your organization match, or directly via PayPal. My 14 yr old daughter Elle and her friend participated in a Google sponsored Girls in Tech robotics event, and through that they both felt what it is like to engage in technology in a fun and challenging robotics competition, in which they came in FIRST place. They never before felt such empowerment and satisfaction through their efforts! Purely due to that experience they are both fired up to do more. X Academy is sponsoring this program. This program aims to inspire and empower the next generation of female innovators. This new girls team will compete using the VEX V5 robotics system, and this is where we need help sourcing the funds for the equipment. Donate Now: PayPal Donation Link https://lnkd.in/gW7HqRAP Thanks for your support, and full details below, -Russsell What is X Academy The X Academy (https://www.xacademy.org/) is a parent-led 501c3 nonprofit celebrating its 10th year of providing STEM enrichment for middle and high school students throughout Santa Cruz County. Over 500 middle school students experienced the joy of challenging math through the Math Circle and Julia Robinson Math Festivals. In June this year, the X Academy high school robotics team won 3rd place at the MATE ROV World Championship. Why Your Support Matters STEM education (Science, Technology, Engineering, and Mathematics) plays a crucial role in shaping our future.By supporting our girls’ robotics team, you are helping to build a strong foundation for these young women to excel in these fields and contribute to groundbreaking advancements in technology and engineering. We're passionate about ensuring that robotics is a welcoming and empowering space for all. We want girls to feel like they have a place in robotics. We recognize that historical biases, stereotypes and limiting self-perceptions can discourage girls from pursuing STEM fields, and we're committed to changing that narrative. How You Can Help To make this initiative a success, we need to raise a fund of $7500 for the VEX V5 robot (parts and tools), playfield setup, and competition fees. Your generous donation will directly support these essential components, ensuring that our team has the resources they need to compete and thrive. Corporate Matching Opportunities If you are affiliated with a company that participates in employee donation matching programs, we encourage you to donate through your company’s Benevity portal. Many companies offer to match donations, effectively doubling your impact. X Academy is listed on Benevity, making it easy for your company to contribute. We are incredibly grateful for your support and commitment to fostering the next generation of female leaders in STEM. Together, we can make a significant difference.

8

Hey folks! Garrett Milster and I have only posted about Sacramento Labs once, so we figured it's time for an update 😊 **What is Sacramento Labs?** We’re a small team focused on launching software products that solve real-world problems. Think of us as a startup lab—constantly testing ideas, learning from feedback, and building tools that matter, and having an impact while doing it. **How do we decide what to build?** We like to build products that: -         Solve real-world problems in mostly ignored industries -         Are small, highly maintainable, and scalable codebases -         Make the world a better place directly, or by donating a percentage of profits to a relevant charity in that space You can learn more about our philosophy at sacramentolabs.com **What you can expect from us** We’ll be posting product ideas that are in various stages of our pipeline: Early Concept, Customer Development, In Progress, Launched, Scaling. We’d love to hear your feedback! **Our latest concept: Self-Hosted Security** Here’s the problem: - Businesses often use third-party URL shorteners to share internal tools, resources, or campaigns, but these services introduce serious risks. Enterprise companies like Google, Microsoft, and Stripe have built their own internal URL shorteners for this reason – but most businesses don’t have the resources to do that. - Phishing attacks are rampant, and links from external services can be spoofed or abused. - Branding and security controls are limited, leaving sensitive information exposed. - You can’t track link activity—who’s clicking what, when, or why. - When employees leave, their shared links still work, leaving potential vulnerabilities. Our proposed solution: Self-Hosted Security. It’s a plug-and-play solution for businesses to host their own branded URL shorteners with: - SSO for secure access tied to your company’s directory. - Link expirations to ensure old links don’t stay active indefinitely. - Audit logs to track activity and improve visibility into link usage. 📢 We need your input! Would this solve a problem for you? What features would make this indispensable? Check out the landing page and share your thoughts: selfhostedsecurity.com Want to chat? Email me at [email protected] 😊 💡 And here’s something we’re passionate about: a percentage of profits from Self-Hosted Security will go to the Electronic Frontier Foundation (EFF). Your feedback not only helps us create better solutions, but also contributes to making a positive impact. Thanks for being part of the journey!

53

4 Comments