rushang vora

#Dataengineer #C2H Total Exp : 7Y + Budget: 1.2L Candidates worked on one project in the #Datacom / #Telecomdomain. Focus on #Databricks, #AWS an Airflow and 1-2 DB in the list. from the #Azure background. Mandatory keywords #Hands on exp Workflow orchestration: Dagster, Airflow   SQL   PostgresDB/timescaledb/DuckDB/ influxdb Kafka Databricks Delta Lake #DM

3

[New Premium Video Alert] SQL Server Indexing Strategy Puzzle Solved by Amit R S Bansal Watch the full video on SQLMaestros https://bit.ly/sqlmaestros More Premium Videos: https://lnkd.in/gUfaiS-Z Share. #SQLServer #SQL #TSQL #AzureSQL

1

WITH cte AS  ( SELECT searches, ROW_NUMBER()OVER(ORDER BY searches ASC) AS row_asc FROM (SELECT  *,GENERATE_SERIES(1,num_users,1) AS freq FROM search_frequency ORDER BY searches ) AS subquery ) SELECT ROUND(AVG(searches),1) AS median FROM cte  WHERE row_asc = (SELECT COUNT(row_asc)/2 FROM cte) OR     row_asc = (SELECT (COUNT(row_asc)/2)+1 FROM cte)     ;

1

[New Premium Video Alert] Execution Plan Compile Cost by Amit R S Bansal Watch the full video on SQLMaestros https://bit.ly/sqlmaestros More Premium Videos: https://lnkd.in/gUfaiS-Z Share. #SQLServer #SQL #TSQL #AzureSQL

1

A nice and simple lecture on apache spark , thank you Purnima Pandey What is Apache Spark? - Lec 1

10

Apache Doris provides a wide range of disaster recovery mechanisms: ☑️ MySQL Dump/Source For small data size Recovered data at the specified location in the MySQL Client ☑️ Export/Import For large data size Recovered data in HDFS, object storage, or local file system ☑️ Outfile Recovered data in HDFS, object storage, or local file system ☑️ ADBC For data science usage ☑️ Backup/Restore Native data backup and restoration support Recovered data in HDFS or object storage ☑️ Tiered storage for hot and cold data Recovered data in SSD, HDD, HDFS, or object storage ☑️ Cross-Cluster Replication (CCR) Near real-time data synchronization from cluster to cluster

14

[New Premium Video Alert] SQL Server Eager Index Spool (Detailed) (by Amit R S Bansal) Watch the full video on SQLMaestros https://bit.ly/sqlmaestros More Premium Videos: https://lnkd.in/gUfaiS-Z Share. #SQLServer #SQL #TSQL #AzureSQL

1

Apache spark/Big Data Interview Question! 1. How many maximum task you can execute parallely on cluster. Simple Ans - Depending on the maximum cpu core.. Let say we have 10 node cluster and each node has 15 core cpu and 64 Gb Ram 1 node have 15 CPU Core So 10 node have 15 * 10 = 150 Now we have maximum 150 cpu core. Hence we can execute maximum 150 Tasks. 2. How many partitions will create on 10 Gb file. Simple Ans below… Default size of each block is 128 mb File size is 10 GB. 1 GB have 1024 Mb So 10 GB have 10240 Mb So Will divide 10240/ 128 ( Default Parttion Size) = 80. Hence there would be total 80 Partitions. #pyspark #bigdata #interviewquestions #databricks

54

SQLSatSD: Advanced Techniques in SQL Server Performance & Optimization by Navya Alapati Join this session to explore advanced techniques for optimizing SQL Server performance. Learn how to fine-tune queries, utilize indexing strategies effectively, and optimize database schema designs for maximum efficiency. Discover insights into query execution plans and performance monitoring tools to identify and resolve bottlenecks. Gain practical tips on memory management, caching strategies, and best practices for maintaining high-performance databases. Whether you're managing large-scale data or enhancing application responsiveness, this session equips you with essential skills to elevate SQL Server performance and optimize database operations. https://buff.ly/3SnQEPx #sqlsatsd #sqlsaturday #sqlsat #sandiego #freeevent

1

[New Free #SQLServer Video Alert] Capturing TSQL Antipatterns with Extended Events (by Amit R S Bansal SQLMaestros) Watch the full video on SQLMaestros https://bit.ly/sqlmaestros Pls Share. Follow AB on twitter https://lnkd.in/eS8rTCY #SQLServerWithAmitBansal #SQL #SQLAzure

1

https://zurl.co/Xhwa How do Bloom Indexes work in PostgreSQL? #PostgreSQL #DBA #SQL #DatabaseSystems #OLTP #OLAP #Data #MySQL #Cloud #DevOps

7

https://zurl.co/Xhwa How do Bloom Indexes work in PostgreSQL? #PostgreSQL #DBA #SQL #DatabaseSystems #OLTP #OLAP #Data #MySQL #Cloud #DevOps

5

Microsoft Fabric in Hindi (New Feature!): DAX Calculated Columns & Tables| Column Header Grouping: https://lnkd.in/g7W8d34f #microsoftfabric #DAXCalculatedColumns #DAXCalculatedTables #dataPipeline #Pipeline #powerbi #Warehouse #Dataflow #DataflowGen2 #DataFactory #OneLake #Intergated #analytics

41

2 Comments

Enter the ultimate face-off: Apache Spark vs. Apache Hadoop. These two powerful tools serve distinct purposes.                Know more ......          👇👇👇👇👇👇👇👇👇👇👇👇👇 https://lnkd.in/gYAFCM7b #Apachespark #ApacheHadoop #DataProcessing #RealTimeAnalytics #BatchProcessing #BigDataTools #DataAnalytics #CloudComputing #DataStorageSolutions #MachineLearning #DataArchitecture

2

Here are some crucial topics to prepare for Databricks Data Engineering interviews: - Unity Catalog - Auto Loader - Delta Tables - Delta Live Tables - Spark Concepts - Managed vs External Table - Types of Cluster in Databricks You must prepare these topics before sitting in your data engineering interviews. Do follow Arun Kumar and ForumDE for more such interview guidance. My latest Data Engineering batch just started on this Sunday.Do connect us on 7870970617 to enroll yourself. Visit our website :- https://forumde.in/ #DataEngineering #Databricks #InterviewPrep

32

4 Comments

☁ Azure Data Factory ☁ 🌩 Session 37: Switch Activity 🌩 ➡ Learn how to create a data pipeline in data factory using switch activity. Watch the YouTube video and follow me in the hands-on. Video: https://lnkd.in/dTcDvj35 Channel: https://lnkd.in/dqFehkhE #azuredataengineer #azuredatafactory #dataengineering

22

Video from the session is live on Youtube. Check out What's new for developer in PostgreSQL 17 https://lnkd.in/d3MN8vb8 #PostgreSQL #WhatNew #PostgreSQL17

36