Michael Kalika

  Tel Aviv and IBM teams question the conventional benchmarking practices, which typically involve training models from scratch with random initialization as modeling long-range dependencies in sequences has led to notable architectural advancements, with state space models (SSMs) emerging as a significant alternative to Transformers. According to the team, this method may overestimate the differences between architectures.   The researchers propose pretraining models using standard denoising objectives with downstream task data, a method they term selfpretraining (SPT). This approach significantly narrows the performance gap between Transformers and SSMs. For example, pretrained vanilla Transformers can match the performance of advanced SSMs like S4 on benchmarks such as the Long Range Arena (LRA). Specifically, SPT improved the best reported results of SSMs on the PathX-256 task by 20 points.   Key findings from the study include:   1. Transformers vs. SSMs: Properly pretrained vanilla Transformers can achieve performance comparable to S4 on LRA tasks, challenging the notion that Transformers are less capable of modeling long-range dependencies. 2. Redundancy of Structured Parameterizations: Structured parameterizations in SSMs become mostly redundant with data-driven initialization through pretraining, suggesting that simpler models can match the performance of more complex architectures. 3. Effectiveness Across Data Scales: SPT is particularly beneficial when training data is scarce, with relative gains more pronounced with smaller datasets. 4. Adaptability of Convolution Kernels: Data-driven kernels learned via SPT adapt to specific task distributions, enhancing performance on long-sequence tasks.   The study emphasizes the importance of incorporating a pretraining stage in model evaluation to ensure accurate performance estimation and simplify architecture design. This approach not only provides a fair comparison between different architectures but also highlights the efficiency of pretraining in leveraging task data.    Arxiv: https://lnkd.in/enaH3mhu

1

Free online course - introduction to the world of simulation: monte carlo in everyday life. https://lnkd.in/eP5ngR3T

3

We (Guy Rozenblatt, Seffi Cohen, Lior Rokach and Bracha Shapira ) are thrilled to announce that our paper, "FairUS - UpSampling Optimized Method for Boosting Fairness," has been accepted for presentation at the 27th European Conference on Artificial Intelligence, taking place from October 19-24, 2024, in Santiago de Compostela. 🤖 "FairUS" introduces a novel bias mitigation method that employs GenAI technology (CTGAN) to synthesize upsampled data to the training set. “FairUS” Optimizes both fairness and model performance with less synthetic data than traditional methods.🦾 We look forward to sharing our findings and engaging with fellow researchers and professionals in the AI community at ECAI 2024. #ECAI2024 #AI #MachineLearning #ResponsibleAI #Fairness #FairUS #GenAI #BGU #ArtificialIntelligence #DataScience

94

7 תגובות

I had the honor of being interviewed by Globes about the recent groundbreaking advancements from OpenAI and Google. It's fascinating to witness the rapid pace of innovation and how these giants are pushing the boundaries of what's possible with AI. Key takeaways from the interview: OpenAI's GPT 4o Launch: OpenAI introduced GPT 4o, a model that’s twice as fast and half the cost of its predecessor. With 100 million active weekly users, the goal is to make AI models even more accessible and integrated into daily life. Exciting features like video calls with ChatGPT are on the horizon! Google's Gemini Upgrade: At Google’s annual developer conference, they showcased enhancements to their AI model, Gemini, which can now handle more data and produce even more sophisticated outputs. Google also emphasized the integration of AI in their search engine and the development of advanced personal assistants. The Future of AI: Both companies are striving towards creating intelligent personal assistants that can handle a myriad of tasks seamlessly. This includes recognizing emotions in voice and eventually through video. In the interview, I mentioned: "Until now, integrating individual text segments into models was a manual process. The future model aims to provide continuous and comprehensive responses, seeing everything you see. However, it's unclear when this will become a reality." Challenging Business Models: It's intriguing to see how these companies might be disrupting their own business models. OpenAI’s move to offer GPT-4 for free aims to build a vast user base, which could convert to premium users in the future. For Google, integrating AI into search might reduce ad revenue but is essential for maintaining relevance. NVIDIA’s Crucial Role: Both OpenAI and Google acknowledge NVIDIA’s pivotal contribution with their advanced GPUs, which are essential for these AI advancements. This collaboration underscores NVIDIA's importance in the AI ecosystem. The AI landscape is incredibly dynamic, and it's a privilege to be part of this revolution. Looking forward to seeing how these technologies evolve and shape our future! Link: https://lnkd.in/dn_hFv5K

14

Great accomplishment to our cyber ecosystem, Eleven Israeli startups are featured in the Rising in Cyber list, which highlights the most promising cyber companies in the U.S. https://risingincyber.com/ The project was organized by the global venture capital fund Notable Capital, in cooperation with the NewYork Stock Exchange, Fenwick, and HSBC Innovation Banking. The list includes: Gomboc.ai , Oligo Security , and Wing Security among the 10 early-stage companies; Astrix Security, Descope , and Grip Security at the mid-stage; and Cyera , Drata , Island , Orca Security , and Wiz at the growth stage. The Rising in Cyber survey of more than 100 security leaders revealed three innovation drivers needed by security teams to adapt to a growing footprint of technologies, the rise of AI, and the evolving sophistication of cyber criminals. These themes provide a glimpse into the future buying patterns of CISOs. 1. Identity and Access Management The rise of non-human actors and identity-centric, malware-free attacks, which accounted for 75% of incidents in 2023, highlights the urgent need for robust identity and access management (IAM) solutions. Startups are stepping up with next-generation Identity Governance and Administration (IGA), new authentication platforms, and privileged access management tools. 2. Cloud Security With the transition to multi-cloud architectures, traditional security tools remain inadequate for cloud environments. Innovations in cloud detection and response, data security, automation, risk management, and AI threat detection are becoming essential. 3. Application and Code Security The widespread use of open-source code introduces new vulnerabilities, while AI supercharges product security teams. Startups enabling collaboration between developers and security teams are leading the way, with AI improving code remediation and testing.

16

2 תגובות

Revolutionizing Construction Data Management: Unlocking Efficiency and Insight with Innogration Technologies

3

We're excited to introduce Nadav Kaduri, a talented #BI Developer who joined iprosis six months ago. Fresh out of Ben-Gurion University of the Negev with a Computer Science degree, Nadav shares his insights on starting a career in the data field. Why BI Development? Nadav was drawn to this role for its unique blend of technology and data. "It's the perfect mix", he explains. "You get to dive deep into data and work on both backend and frontend development, from building ETL processes and data models to implementing complex dashboards". Tips for Aspiring BI Professionals: 1. Master Data Lifecycle: Start from ETL processes and data modeling, through database structures and SQL querying to data visualization concepts and BI tools. 2. Programming Skills: If you don’t familiar with any kind of programming language – start learning one. It will help you develop custom solutions, optimize workflows, and troubleshoot issues more effectively. 3. Enhance Communication Skills: Strong interpersonal skills are crucial. You’ll need to collaborate with internal teams and external clients to understand their needs, present insights, and ensure BI solutions meet business goals. Nadav's journey at iprosis showcases the exciting opportunities in the BI field. Are you considering a career in Business Intelligence? Share your thoughts or questions below!

29

2 תגובות

Yuval Regev and his BI & Analytics team at Atera, the world’s first AI-powered IT management platform, lifted a core business KPI by 34% using the Loops Feature Impact Model. We are so proud and delighted to work with this leading analytics team. Initially, the naive effect (before/after) of a recent feature release appeared to have a positive outcome. However, with Loops they not only discovered that the causal effect was negative, they were empowered to make a series of iterative changes to maximize the KPI. You can read their case study to learn more about the process Yuval and team applied in making this significant impact on growth at Atera. #productledgrowth #causalml #causality https://lnkd.in/euc2JQDU

17

1 תגובה

𝗪𝗶𝘇 𝗥𝗲𝗷𝗲𝗰𝘁𝘀 $23 𝗕𝗶𝗹𝗹𝗶𝗼𝗻 𝗢𝗳𝗳𝗲𝗿 𝗳𝗿𝗼𝗺 𝗚𝗼𝗼𝗴𝗹𝗲: 𝗛𝗲𝗿𝗲’𝘀 𝗪𝗵𝘆 𝗧𝗵𝗶𝘀 𝗶𝘀 𝗮 𝗚𝗮𝗺𝗲-𝗖𝗵𝗮𝗻𝗴𝗲𝗿 𝗶𝗻 𝗖𝘆𝗯𝗲𝗿𝘀𝗲𝗰𝘂𝗿𝗶𝘁𝘆 🧵 Wiz, an Israeli startup, just rejected a $23 billion acquisition offer from Google. If consummated, it would have been the largest acquisition ever made by Google. Why did they walk away? Let's break it down. The CEO of Wiz, Assaf Rappaport, shared this in his memo to employees. Though flattered by the offer, Wiz decided it was better off independent, focusing on an IPO and reaching $1 billion in annual revenue. It's about more than money. The offer was enticing. Alphabet's $23 billion bid was a massive premium over the $12 billion valuation of Wiz. But Wiz's management thinks it can improve the company independently, with aspirations of becoming one of the largest cybersecurity firms in the world. Wiz's last funding round closed with a fundraise of $1 billion and was valued at $12 billion, not just a startup in cybersecurity. The founders sold the previous company, Adallom, to Microsoft and believed in Wiz's future. Major setbacks to Alphabet in recent M&A – walking away from HubSpot – made this decision all the more important. And now as Google was looking to pad its cloud and cybersecurity capabilities; it is back to the drawing board. Wiz's rejection of the offer has implications beyond this deal. It signals confidence in one's own growth trajectory and might light up more consolidation in the cybersecurity space. The gap will likely send tech giants scrambling. This decision makes the trend realized in the change in the landscape of tech. More and more startups have shown that growth is preferred to independence over a quick, lucrative exit. It is a very strong statement about ambition and the future of tech innovation. Let me know in the comments what do you think about Wiz's decision? #AIRevolution #Cybersecurity #TechNews #StartupSuccess #Innovation #FutureOfWork #Google #TechAcquisition #AIJobs #DigitalTransformation #TechTrends #Entrepreneurship #IPO #TechIndustry #BusinessStrategy #ArtificialIntelligence #GrowthMindset #Leadership #MarketTrends #BusinessGrowth #FutureOfTech #TechLeaders #IndustryInsights #TechMergers #AIImpact #Leadership #Innovation #Business #Success #Entrepreneur #Marketing #DigitalMarketing #SocialMedia #Networking #Career #JobSearch #ProfessionalDevelopment #Workplace #HR #Recruitment #Startups #SmallBusiness #Motivation #Inspiration #Productivity #Teamwork #Collaboration #Skills #Learning #Technology

6

🚀"It's Not a Bug, It's a Problem: Tech Recruitment Processes Need an Update" In this insightful article from Calcalist, I had the opportunity to share my perspective as the CEO and Founder of Webiz International on the challenges posed by outdated recruitment practices in the high-tech industry. ⚡️ A must-read for anyone passionate about the future of hiring!

8

3 תגובות

𝐃𝐨 𝐕𝐞𝐠𝐚𝐧𝐬 𝐄𝐚𝐭 𝐁𝐚𝐜𝐨𝐧? 🥓 Google invests billions in 🇮🇱 Israeli technologies and companies. Some of Google's (or Alphabet Inc.'s) largest acquisitions have been Israeli innovations, from Waze ($1.3Bn acquisition in 2013) to Wiz ($23Bn acquisition discussions in 2024). Yet, the 𝑩𝑫𝑺 𝒎𝒐𝒗𝒆𝒎𝒆𝒏𝒕, which promotes boycotting 🇮🇱 Israeli products, happily uses Google services to spread their message. For instance, the 𝐍𝐨 𝐓𝐡𝐚𝐧𝐤𝐬 𝐚𝐩𝐩, which helps consumers avoid Israeli products in supermarkets, has over 1 million downloads. Ironically, these users are consuming ads and paying Google for the privilege, all while using the 𝐀𝐧𝐝𝐫𝐨𝐢𝐝 𝐎𝐒, another Alphabet Inc. product. This contradiction reveals a lack of a moral compass guiding the BDS movement. It's all about convenience. They boycott Israeli canned goods, fresh produce, and other small items but rely on Israeli technology to identify products to boycott! As a carnivore, I used to love cheese and crackers, couldn't resist the smell of bacon, and enjoyed all kinds of cakes. But as a vegan, none of those appeal to me anymore because I refrain from eating animal products. I commend people who devote themselves to a specific way of life they believe in. However, I think a lot less of those, like BDS supporters, who make noise but don't follow through with their convictions. FUN FACT - Israel's 🍉 Watermelon harvest is greater than any other Middle Eastern (Arab) country and 6X Palestinian production (89M tons). 𝐒𝐮𝐩𝐩𝐨𝐫𝐭 𝐈𝐬𝐫𝐚𝐞𝐥, or don't. Love Jews, or don't. I don't care either way. Just make up your mind and follow through. If you're a vegan, don't eat bacon. 🌱

35

8 תגובות

Three Israeli Startups Selected For Google’s AI First Accelerator 15 companies were selected for the Google for Startups Accelerator: AI First, among them there are 3 companies from Israel. The program will take place over 10 weeks. It was developed in partnership with Google Cloud and Google DeepMind. The chosen Israeli participants are: - Bagel AI (Yakum, Israel) empowers product teams to continuously quantify and validate their roadmap, maximize impact, and accelerate revenue.  - Dtect Vision (Tel Aviv, Israel) addresses the growing threat of misinformation in the finance sector by leveraging AI to detect deep-fake video, audio, and content. - Geneyx Genomex Ltd. (Herzliya, Israel) is an AI bioinformatic multi-omics platform for clinical genetics data management. Startups will also benefit from additional support and expertise from Google AI and receive Google Cloud credits. Source: https://lnkd.in/d93CTsqz Photo: Google Tel Aviv office.

3

1 תגובה

OTORIO's new Head of R&D ‫ ‫Ben Dahan discusses the critical challenges of cybersecurity in today's fast-evolving landscape and how to overcome them at Ben-Gurion University of the Negev

32

1 תגובה

Noy Tal and Omri Limor did an excellent job answering some of the top questions from Sentra users about our data security platform. They covered how Sentra classifies data, what shadow data is, how Sentra identifies it, and more. If you missed the previous episode where they answered some of the most searched DSPM questions, you can watch it out here 👇 https://lnkd.in/dxN5fjKr

44

1 תגובה

I'm thrilled to share that I've completed an advanced course in Natural Language Processing with Deep Learning! From the foundational concepts of word vectors introduced by Prof. Manning to the cutting-edge technology of transformer architectures, this course has significantly enhanced my skills in several key areas: - Neural Networks & Dependency Parsing - RNNs, Language Models, and Neural Machine Translation - Attention Mechanisms and Transformers A highlight for me was diving into transformer architectures using PyTorch, where I discovered this fascinating fact: multiple transformer heads develop their unique focus to different part of the context text, this behavior is emergent from training and not programmed/defined in the architecture. 🔮 Looking Forward: I believe that the efficiency of computation and cheap inference will be big in the near future, making AI more accessible and sustainable. The future is about cheaper, not just bigger, LLMs. Thank you, Stanford University, for another incredible learning opportunity. Looking forward to apply these insights in my work, driving innovation and delivering solutions that are not only powerful but also pragmatic. #ArtificialIntelligence #MachineLearning #NaturalLanguageProcessing #StanfordUniversity #LifelongLearning #AI

35

4 תגובות

Exciting times ahead! As we enter a new era dominated by AI, I’m proud to announce the creation of The Institute - Israel's AI Advancement Center The Mission is to create a strong AI research infrastructure in Israel to develop global solutions in healthcare, finance, cybersecurity, climate science, and robotics. Why it matters? Cutting-Edge AI Research: at The Institute, they're pushing boundaries in AI to solve global challenges—from healthcare to environmental sustainability. Modernizing Zionism: evolving Zionism into a contemporary framework emphasizing technological innovation and global collaboration. Educational Excellence: aiming to educate and empower thousands in the AI field, making Israel a hub for AI knowledge and leadership. Collaborative Ecosystem: Thanks to partnerships with giants like NVIDIA, Microsoft, Ben Gurion University, and many more, this isn't just a vision—but a reality. Let's lead the AI revolution together. Check out the future of AI at work 🔽 #AIForGood #Innovation #GlobalLeadership #TheInstitute #FutureOfAI #TechLeadership #IsraelInnovation

5

3 תגובות

Yesterday at the Knesset, I had the privilege of representing the מערך הדיגיטל הלאומי - Israel National Digital Agency alongside Nir Yanovsky Dagan in a special committee discussion on AI, Cloud and the Israeli High-Tech sector. We engaged with numerous leaders from the Israeli Data and AI Ecosystem to explore the remarkable growth potential, investment opportunities, and rapid advancements that have defined our field over the past two years. It was truly inspiring to witness the strong collaborative spirit and shared commitment to strengthening Israel's leadership in AI and technology. The connections forged among government, business, academia, and civil society are essential for turning this vision into reality. We stand at a unique and significant crossroad, with a moment in time that we must leverage and embrace. The risks associated with inaction are daunting. We are committed to taking decisive action now, together, across the Ecosystem and I feel fortunate to collaborate with such dedicated and intelligent partners who share our sense of urgency! #AI #Data #Cloud #Innovation #growth

20

1 תגובה

The rise of AI, with tools like Google’s NotebookLM, is driving an incredible shift in how companies create and execute strategies. AI is no longer just about efficiency; it’s reshaping creativity, automating processes, and pushing boundaries in content creation and distribution. Imagine a world where AI handles your entire marketing plan—this is the future unfolding today.

6

1 תגובה