Sara Fernández Carmona

Approaches Used by State-of-the-Art Vision-Language Models for Handling High-Resolution Images https://ift.tt/0IYse5B Have you ever failed to ask a Vision-Language Model (VLM) to search for specific objects or thoroughly explain details about a high-resolution image? Image by V* Visual Search paper When I studied about multimodal large language models (MLLMs), I face a significant challenge: these models depend heavily on pre-trained vision encoders like the CLIP image encoder, which are trained on smaller-scale images — typically 224x224 or 336x336 pixels. This training approach poses a problem when deploying these models, as images are often downscaled to similar resolutions, resulting in the loss of crucial details in higher-resolution images. Therefore in this article, I will introduce the four most recent methods and provide a middle-level explanation of each method to ensure clarity and accessibility for all readers. Ineffective Methods for Processing High-Resolution Images Image by FlexAttention paper (a) Using Low-Resolution Vision-Language Models (VLMs): I find that these models downsample high-resolution images to meet vision encoder standards. This often results in significant detail loss, which hampers the model’s ability to accurately address queries about the image. (b) Employing High-Resolution VLMs: While these models handle high-resolution images directly, they consume a large number of image tokens, leading to excessive computational demands and inefficiency. 4 Recent Research on the Issue 4.1 FlexAttention for Efficient High-Resolution Vision-Language Models Image by FlexAttention paper This method focuses on important parts of high-resolution images. Nonetheless, the FlexAttention module can be added to many vision-language models by replacing their usual self-attention modules with FlexAttention. To enhance efficiency, the method starts with low-resolution image tokens and text tokens in the initial NSA layers to get a basic understanding of the entire image. In later NFA decoder layers that include FlexAttention selected high-resolution image tokens are also fed into the system to capture more detailed image information effectively. FlexAttention comprises two distinct modules: 4.1.1 A high-resolution feature selection module It flexibly selects important tokens for processing based on an attention map. The main idea is from Autoregressive LLM, where the next token is predicted by the last hidden state of the last token. A high-resolution feature selection module. Image by FlexAttention paper The module extracts key values from the last columns of attention map, reshapes them into a 2-D mask that highlights important patches in low-resolution images, and then normalizes and resizes this mask. This resized mask is used to determine which high-resolution features to focus on in subsequent processing layers. 4.1.2 A hierarchical self-attention module It is designed to fuse the selected...

I have a question for Booking Engines operating in the Italian market. Are you aware that in 2024 it's unacceptable to track what happens on your website solely with GA4? Furthermore, do you realize how this is harming web agencies like ours, which cannot use Google Ads' Native Conversions? Obviously, this also damages the end customer who lacks awareness of the correct ROAS and ROI. What should we do? Should we build our own Booking Engine? Are you open to collaborating? We are available. Don't want to collaborate? Then please get up to speed and stop charging hoteliers for upgrades that you should have made years ago. P.S. The way you've set up the event parameters for GA4 is pitiful.... What should we do then?

Rank Math Review: The little-known truth that no one’s talking about 🔍 https://lnkd.in/daqZ-MAN 👉 The plugin we have been using for years. #SEO #WordPress #wordpressplugins #review

HubSpot blog claims you can use robots.txt to "remove a page from search engine results". Is it just me or is this NOT correct? I just want to check I'm not talking out my hoop before I contact HubSpot. In this https://lnkd.in/ekB_-6VT they list "3 Ways to De-Index a Webpage From Search Engines". The first one is to "remove a page from search engine results by adding a robots.txt file to your site". It goes on to say that the "advantage of using this method is that you can get more control over what you are allowing bots to index." I believed that robots.txt was used to manage crawler traffic to your site. The post does go on to mention this is a way to "proactively keep unwanted content out of search results." For a start, that seems contradictory because this part of the post is about how to remove (de-index) pages from Google. But I'm pretty sure Google Search Central's advice on robots.txt warns strongly against doing this: "Warning: Don't use a robots.txt file as a means to hide your web pages (including PDFs and other text-based formats supported by Google) from Google search results. If other pages point to your page with descriptive text, Google could still index the URL without visiting the page. If you want to block your page from search results, use another method such as password protection or noindex." Am I missing something here?! ​ Edit: thanks all, sounds like my suspicions were indeed right. u/Illustrious-Wheel876 put it quite succinctly: "blocking a crawled/indexed pages deindexation pages that are linked to continue to be indexed". They added that "most orphan pages blocked by robots.txt will likely fall from the index" - which was something I hadn't considered before now. #techseo #seo #robotstxt #technicalseo #seotips #oncrawl #digitalmarketing #seowithsai #searchengineoptimization #crawling #seostrategy #seohacks #contentoptimization #content #payperclickadvertising #googleadsagency #ppcmarketing #payperclickmarketing #payperclick #googleadsspecialist #googleadsmarketing #socialmediamarketingstrategies #googleadswords #googleadsexpert #googleadstips #seotipsoftheday #ppcagency #socialmediamarketingstrategist #socialmediamarketingservices #localseo

The English version of my site is dropping, not the original Spanish one My website lists 400,000 products with 400,000 URLs, in two languages: Spanish (original first site): https://lnkd.in/e7dzcqUd English (launched 7 years later): https://lnkd.in/eJDmAuTA Although the risk of thin content, the Spanish version is indexed and ranked pretty well. However, the English one was penalized in the last two Google Updates, and the number of URLs under "Crawled, currently not indexed" is 234,000 (in the Spanish version this figure is 75,000). Some facts: As far as I have checked with different tools, the hreflang tag is ok in every URL of the products, from English to Spanish and vice-versa Each Spanish URL links, with rel=nofollow, to the English URL and vice-versa, with the text "In English" or "In Spanish" According to 'ahrefs', the Spanish version has 691k backlinks (2% dofollow) and 1.8k linking sites (84% dofollow), with Domain Rating of 47. The English version, 672k backlinks and just 339 linking sites (66% dofollow), with Domain Rating of 47. According to 'moz', the Page Authority of 'www.example.com' is 50, 'en.products.example.com' is 44 and 'products.example.com' is 43. From 'www.example.com' I've got just one link, to 'products.example.com' (the Spanish version). English is not my mother language, and I did my best to translate manually the common texts ("name of the product", "you can find the product in the following shops", etc). I do not use automatic translation for the whole page. I would appreciate hearing from similar experiences. #techseo #seo #robotstxt #technicalseo #seotips #oncrawl #digitalmarketing #seowithsai #searchengineoptimization #crawling #seostrategy #seohacks #contentoptimization #content #payperclickadvertising #googleadsagency #ppcmarketing #payperclickmarketing #payperclick #googleadsspecialist #googleadsmarketing #socialmediamarketingstrategies #googleadswords #googleadsexpert #googleadstips #seotipsoftheday #ppcagency #socialmediamarketingstrategist #socialmediamarketingservices #localseo

Report: Google Search traffic and queries not impacted by new competing AI search engines https://lnkd.in/dTG_WhrC New data from Datos’ clickstream panel analyzed by Sonata Insights showed Google traffic grew over the year, despite all the new AI competitors.