Qidong Xu

Learn how Manifest MedEx actively works toward advancing a digital health data safety net in California, bridging gaps across large urban centers and rural communities. More below!  

1

In new work at UCSC announced recently, researchers demonstrate how to dramatically improve the energy efficiency of LLMs while maintaining performance by eliminating resource-intensive matrix multiplication operations and leveraging custom accelerator hardware. At the core of the work is a scalable LLM approach that uses additive operations in dense layers and element-wise products for self-attention functions. For their GPU implementation, which employs CUDA kernel optimizations on standard Nvidia GPUs, they saw significant acceleration and reduced memory consumption for training, and for inferencing they saw far greater performance improvements and memory usage reductions, especially when the model is scaled to 13B parameters. The dramatic energy savings is seen on a custom FPGA accelerator which exploits lightweight operations not available on today's GPUs. The work suggests the potential for impressive advancement of lightweight LLMs, as well as a new direction for future LLM hardware accelerators. UCSC Newcenter article: https://lnkd.in/gqzqqF_w

16

1 Comment

Santana Row shopping center in San Jose has implemented a ticketless parking system that eliminates the need for drivers to take a ticket upon entry and pay at a pay station upon exit. Instead, drivers can simply scan a QR code (see photo) posted throughout the garage using their phones, enter their license plate number and credit card information on the website that pops up, and a camera will read their license plate and open the gate as they exit. While this system may seem convenient and efficient, I think there is a significant security concern! There is a risk that perpetrators could replace the posted QR code with their own, which would redirect drivers to a fake website where they would unknowingly enter their credit card information. This could lead to unauthorized charges and potential identity theft. It is crucial for the shopping center to address this security concern by taking appropriate measures to protect drivers' personal and financial information. They must ensure that the QR codes posted are authentic and that there are no vulnerabilities that could allow perpetrators to manipulate the system. As an alternative solution, pay stations could be installed for shoppers to use instead of relying on their own phones.

32

12 Comments

Join us in Irvine on July 17th at 6:30 PM for our latest OC ACM talk, "Systems and Software for Averting an Energy Crisis" presented by Bill Gervasi, a Principal Systems Architect for Wolley Inc. For more info or to RSVP click here: https://lnkd.in/gquYQ2z9 According to a recent Forbes article, "The rise of generative AI and surging GPU shipments is causing data centers to scale from tens of thousands to 100,000-plus accelerators, shifting the emphasis to power as a mission-critical problem to solve." making this talk particularly relevant. #acm #techtalk #gpu #ai #generativeai #nvidia #energy #energycrisis

3

2 Comments

Istio Service Mesh: great to see Ambient moving up to Beta, delta xDS becoming the default, and api-gateway becoming a first class citizen in Istio. https://lnkd.in/gYPmnTuj

34

A data-driven approach to driving wound healing outcomes Marcella Gomez, University of California, Santa Cruz https://lnkd.in/gAkWZYJT Meet: https://lnkd.in/g4AAWkcK YouTube Stream: https://lnkd.in/gwtqaTmf Talk details: https://lnkd.in/gWn3B3cU Subscribe for talk announcements: https://lnkd.in/g5ciuNuX Abstract: Precision medicine requires an ability to predict the response of an individual to a prescribed treatment regimen a priori. Thus, advancement in the field is challenged by a lack of predictive models and, arguably, a lack of time-series information for a highly dynamic system. Here, we discuss work in wound healing, for accelerating wound closure. We argue that timing of treatments is as critical to consider as the choice of drug or therapy. Due to system size and complexity, data-driven methods need to be explored to develop multi-dimensional quantifiable indicators tracking systemic changes. In this work I discuss how bioelectronic devices enhanced with deep learning can help facilitate real-time sensing and actuation for automated decisions in treatment for wound healing and preliminary work in transcriptomic based classification of wound states. Bio: Marcella M. Gomez is an associate professor at UC Santa Cruz in the department of Applied Mathematics and Associate Dean for Diversity, Equity, and Inclusion for Baskin Engineering. She received her PhD from Caltech in 2015 and a B.S. from UC Berkeley in 2009; both degrees in Mechanical Engineering. Her research interests are in the broad field of bio-control leveraging methods in machine learning and control theory. Applications range from controlling single-cell response to driving complex systems such as wound healing. #modeling #simulation #medicine #healing #trauma #predictivemodeling #datascience #data #woundhealing #biology #bioengineering #systemanalysis #sensing #omics

3

Thats the exact explanation I gave to a group of investors last week. (… it’s just Precision/Recall, attributes vectorization as “embedding”, K-Nearest Neighbor, User Search Intent, DAG, ML algorithms, etc all over again …). LOL and they asked what’s new this time around. And I was like not much, ML is still the backbone, and AI is the inference and actions based on the model. It works better when there is a feedback loop in a closed system. But the current state of the art like ChatGPT is based on scraping the Internet (garbage in, garbage out). Kinda like early search engines. What is a better analogy is that NVIDIA/Snowflake etc are selling tools, aka pickaxes to prospectors. The gold is up to you to find. And the opportunity right now is to monetize industry specific (healthcare, travel, financial services) clean data to build models with (aka a treasure map for the prospectors). From an enterprise perspective, what’s out there today aka generative AI isn’t very useful. Too much hype. To build useful engines will require an effort similar to search revolution 2 decades ago. From

16

3 Comments

If you are at AWS re:invent next week. Feel free to drop by PagerDuty booth to learn how we use Pagerduty with snowflake & AWS @ Snowflake. Gaurav Singodia & I would be presenting this session #pagerduty #sre #aws #snowflake #cortex

102

1 Comment

Here is everything that I found interesting last month about irresponsible AI. #blog #engineering #leadership #qfm QFM012: Irresponsible AI Reading List March 2024 https://lnkd.in/e-u-Jyzw

7

1 Comment

Microservices get a bad rap due to complexity and high TCO. A lot of that is because a microservice-based application works the same way as a bunch of dominoes falling. If one misses, or falls out of order, the whole workflow stops. And you have no control over the process once your microservices start ping-ponging events and RPC's back and forth. That's why #microservices are so expensive to manage. Great blog post below by Colt McNealy about how LittleHorse can solve those problems. Give it a read. https://lnkd.in/gJECBwRu

58

AI leaders have a crucial chance to address risks now and strengthen governance practices before playing catch-up to regulations, notes Kjell Carlsson, Ph.D. of Domino Data Lab. In a recent VentureBeat article, he shares his perspective on California's AI bill veto and why proactive governance is key to the future of AI innovation. Learn more about this addressing this opportunity: https://gag.gl/4WCTkP #AI #AIGovernance #AIInnovation #DataScience

1

Back in my volunteer days at the San Jose Suicide and Crisis Hotline, I stumbled upon a peculiar realization: our emotions are often reflective mirrors of those we interact with. Fast forward to today's remote work era, this understanding has proved invaluable as an engineering manager. In a world where Zoom meetings replace in-person interactions, it's easy to feel disconnected from your team. But, remembering my hotline days, I've learned to check-in with my feelings during remote 1:1's, sensing the vibe from the other end. If I'm bored, they likely are too - time to shake things up. If I'm anxious, they could be feeling the same - let's address it. This "emotional telepathy", combined with genuine curiosity about my team, regular check-ins, and consistent career growth discussions, has enabled me to build trust and maintain cohesion, even from afar. Sometimes, the past holds the keys to our present challenges. Looking to navigate remote leadership? Feel free to drop a message. Let's connect, share, and grow together. #Leadership #RemoteWork #EmotionalIntelligence #EngineeringManagement ----------------------------------- Check out the full article at https://lnkd.in/gmUUHFWX

8

1 Comment

AI leaders have a crucial chance to address risks now and strengthen governance practices before playing catch-up to regulations, notes Kjell Carlsson, Ph.D. of Domino Data Lab. In a recent VentureBeat article, he shares his perspective on California's AI bill veto and why proactive governance is key to the future of AI innovation. Learn more about this addressing this opportunity: https://gag.gl/4WCTkP #AI #AIGovernance #AIInnovation #DataScience

3

At Elemental Cognition, we’re transforming #GenAI solutions using #ApacheKafka and Confluent. In this The New Stack article, I shared how our AI platform uses Kafka and Confluent Cloud to stream and vet data in real-time before the EC Reasoning Engine applies formal logic for transparent, accurate solutions. Check out the article for a deep dive into the best practices we’ve learned for building reliable GenAI apps. https://lnkd.in/eU5RupZu

41

4 Comments

AWS announced the launching of RDS rightsize engine. Did anyone had a chance to review this? This is a long awaited feature that could bring a lot of value to customers in optimizing RDS costs, which tend to be significant for many organizations. Although not specifically mentioned in the article, I understand that recommendations will not be generated for instances covered with RI, which I find (very) odd IMHO. Did anyone had a chance to check this? #AWS great 1st step, looking forward to including Aurora in this engine, and more importantly provide a way to control RDS RI coverage, any way - convertible, SPs, marketplace. This would truly be a great holistic view to follow optimization best practice - rightsize than cover (then go do real FinOps). Great kudos to #FinOpsX for creating the stage for #FinOps announcements! https://lnkd.in/gNMSf-wk

14

2 Comments

Join my Data Architecture SNIA session featuring AlloyDB Omni at 11:45 PM PDT today! Discover why a robust data architecture is crucial for successful AI implementations. This session explore strategies to manage, store, and optimize data for maximum performance, efficiency, and scalability. #SNIA, #CMSSummit,#AlloyDBomni, #RAG #vectordatabases #pliops

15